-- Logs begin at Mon 2022-08-08 01:18:05 UTC, end at Mon 2022-08-08 02:41:35 UTC. -- Aug 08 02:02:08.490900 dv-cinder-852261-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 02:02:08.499630 dv-cinder-852261-2-smb devstack@keystone.service[80320]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:02:08 2022] *** Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: nodename: dv-cinder-852261-2-smb Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: machine: x86_64 Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: clock source: unix Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: pcre jit disabled Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: detected number of CPU cores: 4 Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: current working directory: / Aug 08 02:02:08.501767 dv-cinder-852261-2-smb devstack@keystone.service[80320]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: your processes number limit is 47680 Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: your memory page size is 4096 bytes Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: detected max file descriptor number: 2048 Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: lock engine: pthread robust mutexes Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: thunder lock: enabled Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 02:02:08.502290 dv-cinder-852261-2-smb devstack@keystone.service[80320]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:02:08.540948 dv-cinder-852261-2-smb devstack@keystone.service[80320]: Python main interpreter initialized at 0x557c77a2f9c0 Aug 08 02:02:08.540948 dv-cinder-852261-2-smb devstack@keystone.service[80320]: python threads support enabled Aug 08 02:02:08.540948 dv-cinder-852261-2-smb devstack@keystone.service[80320]: your server socket listen backlog is limited to 100 connections Aug 08 02:02:08.540948 dv-cinder-852261-2-smb devstack@keystone.service[80320]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:02:08.541307 dv-cinder-852261-2-smb devstack@keystone.service[80320]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:02:08.541382 dv-cinder-852261-2-smb devstack@keystone.service[80320]: *** Operational MODE: preforking *** Aug 08 02:02:08.541898 dv-cinder-852261-2-smb devstack@keystone.service[80320]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:02:08.541898 dv-cinder-852261-2-smb devstack@keystone.service[80320]: spawned uWSGI master process (pid: 80320) Aug 08 02:02:08.542095 dv-cinder-852261-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 08 02:02:08.542669 dv-cinder-852261-2-smb devstack@keystone.service[80320]: spawned uWSGI worker 1 (pid: 80332, cores: 1) Aug 08 02:02:08.542969 dv-cinder-852261-2-smb devstack@keystone.service[80320]: spawned uWSGI worker 2 (pid: 80333, cores: 1) Aug 08 02:02:08.543123 dv-cinder-852261-2-smb devstack@keystone.service[80320]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:02:14.087452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:02:14.087452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Aug 08 02:02:14.088258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:02:14.088258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Aug 08 02:02:14.088695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:02:14.088695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Aug 08 02:02:14.088818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:02:14.088818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Aug 08 02:02:14.137687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:02:14.137840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:02:14.137931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:02:14.138007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:02:14.138069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] command line args: [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:02:14.138133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] command line args: [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:02:14.138317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:02:14.138413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:02:14.138492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ================================================================================ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:02:14.138570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ================================================================================ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:02:14.138789 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.138868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_dir = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_dir = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_source = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.139626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_source = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.140279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] debug = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.140367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] debug = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.140500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.140811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.140953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.141872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_config_append = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_config_append = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_dir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_dir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.142964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.143843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.144995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.145954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.146866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.147175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.147263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.147755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.147840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.147959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] publish_errors = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] publish_errors = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.148872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] standard_threads = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.149784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] standard_threads = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_journal = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_journal = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.150939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_json = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_json = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_stderr = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_stderr = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_syslog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_syslog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:02:14.151966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.152974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.153097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.153329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.153414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.153649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.153731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.154787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.155207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.155894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.156988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.157897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.158825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.159859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.160991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.161964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.162936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.163934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.164912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.165851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.166964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.167987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.168964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.169967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.170933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.171899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172542 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.172882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.173993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.174970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.175985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.176952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.177878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.178873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.external = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.external = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.179876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.password = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.password = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.token = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.token = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.180999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.181953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.182929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183166 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.183949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.184984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.185922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.186961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.187949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.188976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.189917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.190927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.191965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.192900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.193947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.194961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.195875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.196946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.197947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.198984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.199887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.200942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.201988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.202116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.202745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.202898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.203988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.204919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.205953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.206976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.207932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.208991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.209886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.210845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.211986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.212951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.213921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.214993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.215960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.216951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.217794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.218505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.218637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.218769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.218974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.219878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.220948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.221947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.222994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.223120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.223246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.223372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.223498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.223625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.224926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.225947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.226850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.227862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.228942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.229982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.230877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.231936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:02:14.232062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.232062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.232062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:02:14.232062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:02:14.260363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.260565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.260728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.260857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.260995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.261124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.271228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.271506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.299282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.299491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.299630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.299764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.352501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.352725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.404176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.404407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.404901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.405142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.470245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.470449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.470589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.470721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.470871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.471637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.494517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.494689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.494824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.494964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.495983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.496107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.496239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.507348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.507651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.520541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.520802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.521956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.522094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.522221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.522221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.522467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:02:14.538633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.538843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:02:14.539156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.539286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.539414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:02:14.539555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:02:14.539683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.539840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.539964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:02:14.540224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.540950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.551817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.552101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.552375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.552684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.552818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.553001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.553279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.553568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.559635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.560554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.563318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.563604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.563900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.564190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.564327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.564485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.564622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.564782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.564912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.565914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.566003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.566195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.566275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.566480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.566768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.567051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.590076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.591004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.591596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.591895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.592531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.592908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.596919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.597209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.597500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.597579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.597836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.598125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.604419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.604682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.605020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.605315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.609389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.609683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.609940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.610024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.610885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.611901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.627827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.628112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.628272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.628560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.632155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.632697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.635341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.635645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.635887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.636188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.640243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.640668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.643476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.643875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.646677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.646983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.647957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.648170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.648252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.648495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.664239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.664533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.664834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.664944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.665110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.665240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.665512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.665780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.672772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.673587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.674360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.674644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.675177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.675462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.677476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.677765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.678072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.678316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.678398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.678606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.678689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.678911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.679210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.679498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.690852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.691138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.691427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.691714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.691805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.692004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692574 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.692924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.693209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.693493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.709572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.710230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.712547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.713244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.715529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.716213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.717144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.717848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.718687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.718990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.719294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.719373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.719647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.719947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.726040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.726717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.727662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.728347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.730658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.730955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.731247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.731410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.731532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.731615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.731894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.732181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.740163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.740459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.740774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.741025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.741371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.741675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.747688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.747980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.748269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.748552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.748663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:02:14.748858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.748951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.749688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.749874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.749980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.750893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.751986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.752075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.752277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.752555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.752853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.753122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:02:14.785412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c77a2f9c0 pid: 80333 (default app) Aug 08 02:02:14.786996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c77a2f9c0 pid: 80332 (default app) Aug 08 02:02:14.788665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d5d8-813b-4b7e-9bf8-207cc721c913 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:14.788949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d5d8-813b-4b7e-9bf8-207cc721c913 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:14.789222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d5d8-813b-4b7e-9bf8-207cc721c913 None None] PATH_INFO: `/v3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:14.793536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Aug 8 02:02:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:22.450850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:22.451303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:22.451396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:22.456345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:22.461834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:22.462221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:22.462374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:22.535208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: INFO dbcounter [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] Registered counter for database keystone Aug 08 02:02:22.554160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG oslo_db.sqlalchemy.engines [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:02:22.560226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writer thread running {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:02:22.741925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80333) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:02:22.742249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80333) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:02:22.796797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:22.798404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:22.929052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 08 02:02:23.066113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:23.136463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: INFO dbcounter [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] Registered counter for database keystone Aug 08 02:02:23.157633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG oslo_db.sqlalchemy.engines [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:02:23.163781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writer thread running {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:02:23.283865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8ffb-8ed2-437e-bfdd-3f4d61ade628 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:23.288147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:23.288797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:23.289076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:23.289346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:23.297989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:23.349628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:02:23.349915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a815-e53e-40f2-b3e2-519961a5eed8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:23.359370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Aug 8 02:02:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:02:23.365316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:23.380040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b12b-dbd3-4659-895b-2a1bb18adb26 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:23.384428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:23.385574 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:23.385853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:23.386123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] PATH_INFO: `/v3/projects/b5a665df524c40cebad50de6721ccb89` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:23.387557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5a665df524c40cebad50de6721ccb89)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:23.438174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:02:23.438516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02cab8-eaa0-4423-9620-b659d65f9574 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:23.443188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Aug 8 02:02:23 2022] GET /identity/v3/projects/b5a665df524c40cebad50de6721ccb89 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:25.426863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8942c-0491-4c99-9be0-92d0ced101bd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:25.427403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8942c-0491-4c99-9be0-92d0ced101bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:25.427403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8942c-0491-4c99-9be0-92d0ced101bd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:25.431553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:25.437753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:25.438182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:25.438299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:25.459192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:25.460746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:25.469292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 08 02:02:25.491882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8942c-0491-4c99-9be0-92d0ced101bd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:25.503876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8942c-0491-4c99-9be0-92d0ced101bd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:25.508042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:25.508634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:25.508940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:25.509211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:25.516963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:25.518720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3fae-b751-4d19-b542-9319a1d9ad1e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:25.527350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Aug 8 02:02:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:02:25.533075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:25.542009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2fb8-27e9-4174-8378-7f4845968777 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:25.547016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:25.547631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:25.547911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:25.548180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:25.549512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:25.551324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7fdea-4b8c-4144-b337-7ba72b7b64c8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:25.552870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Aug 8 02:02:25 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:27.591075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde12-d455-47a2-8d9a-6e5d050c9c75 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:27.591609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde12-d455-47a2-8d9a-6e5d050c9c75 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:27.591609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde12-d455-47a2-8d9a-6e5d050c9c75 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:27.592982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:27.598241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:27.598677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:27.598769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:27.617197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:27.618390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:27.655088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d930e-8ce1-4399-9a54-ccd88c16a506 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:27.655368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d930e-8ce1-4399-9a54-ccd88c16a506 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:27.655639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d930e-8ce1-4399-9a54-ccd88c16a506 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:27.657001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:02:27.661946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:27.662222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:27.662490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:27.698891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:27.706296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80332) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:02:27.706723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80332) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:02:27.721933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:27.746173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:27.759075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:27.760685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:27.826500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400cb5-71c4-4d3d-8dc4-854b0b5623bb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:27.861636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:27.862276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:27.862559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:27.862834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:27.863996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:27.874000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:27.882812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:27.883900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:27.885378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:02:27.887316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:27.889530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:27.970087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:27.988548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638799-9319-4c63-9d21-08d71a65d63b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:27.990016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf7e2c-cc80-4aeb-912e-5937ff99342d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:27.990832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:28.026134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.027000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.027125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.027346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.027638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.027729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.027980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.028250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.028934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:28.029280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.031555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.042787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:28.049360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:28.102126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.103705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.206750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:28.212524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:28.215175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:28.255956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2eda1-3ee0-43d0-9b86-4de6baee9840 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:28.289761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.290385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.290662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.290929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.292040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.293544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.295097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:28 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:28.301109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:28.313594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f23e-4970-4d34-bf2d-ec49d23d5761 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:28.318940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:28.348186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.349357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.349639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.349907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.367772 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.369267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:02:28.387150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:28.388026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:02:28.388862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:02:28.388862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:02:28.388862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:28.388862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:02:28.394563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:28.406940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3a09-f314-409f-a279-2f0ab6d8553a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:28.440537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.441203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.441478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.441743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.442851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.444296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.445884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:28.451481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:28.455928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:28.500586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb598c-d271-4ad9-b7cf-36e0f73b0774 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:28.533316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:28.534211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.534866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.535192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.535580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.536206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:28.536506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.537930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3b5b0-7158-438b-955b-2f16c872aec7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.552704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b759-da38-4fc3-8382-af460c19b324 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:28.555641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:28.589422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:28.590055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:28.590334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:28.590630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:28.591369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.domain.id=default, user.id=c7afcca3526940e6b32f29d6912ef770) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:28.591674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:28.593370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056fbb-fdb7-495f-bb87-f796e89a6e34 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:28.601265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Aug 8 02:02:28 2022] GET /identity/v3/role_assignments?user.id=c7afcca3526940e6b32f29d6912ef770&scope.domain.id=default&role.id=c263d8337db14b7e938c9a63cd631fad => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:31.177876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae029e5-e23f-4811-9f52-47cd4b1ca5ef None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.178893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae029e5-e23f-4811-9f52-47cd4b1ca5ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.179403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae029e5-e23f-4811-9f52-47cd4b1ca5ef None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.181005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:31.186591 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c31dc-1e4c-4fe7-9ed2-5adee274b2b7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.187638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c31dc-1e4c-4fe7-9ed2-5adee274b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.188113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c31dc-1e4c-4fe7-9ed2-5adee274b2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.218330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b79c31dc-1e4c-4fe7-9ed2-5adee274b2b7 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:31.219881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b79c31dc-1e4c-4fe7-9ed2-5adee274b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:31.265884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e576b6-46af-4a56-9a67-eaeb8a6dd838 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.266515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e576b6-46af-4a56-9a67-eaeb8a6dd838 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.266994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e576b6-46af-4a56-9a67-eaeb8a6dd838 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.268603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 12/23] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:02:31.273824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc79c-e3b6-4de9-9d0e-7dab8021f8b7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.274362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc79c-e3b6-4de9-9d0e-7dab8021f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.274841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc79c-e3b6-4de9-9d0e-7dab8021f8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.305494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d22cc79c-e3b6-4de9-9d0e-7dab8021f8b7 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:31.307802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d22cc79c-e3b6-4de9-9d0e-7dab8021f8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:31.341695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:31.343119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71958b-3446-4c49-89c3-c51d3d13385c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.343402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71958b-3446-4c49-89c3-c51d3d13385c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.343672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71958b-3446-4c49-89c3-c51d3d13385c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.348674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:31.348674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed57-ce90-4b23-b274-614e619fff0f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.348674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed57-ce90-4b23-b274-614e619fff0f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.348674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed57-ce90-4b23-b274-614e619fff0f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.348674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:31.360447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.360447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.360447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.376387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:31.377624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:31.417799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:31.419421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.419911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.420394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.442215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:31.443754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:31.498151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:31.506281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:31.507694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:31.512772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:31.552590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:31.553625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:31.631262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08944-687b-4d50-a9c7-bbfdd086fbde None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:31.674805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:31.675649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.676126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.676629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.677554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:31.679087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:31.680293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bea58-a744-4288-a6b4-cb6d559e2e21 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:31.721584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:31.722532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:31.723022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:31.723508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:31.734681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:31.736422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:31.810586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 16/30] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:31.818165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:02:31.861282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:31.862339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:02:31.863155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:02:31.863155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:02:31.863155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:31.865286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:31.870814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:31.907556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:31.954050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.005107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ffa3-44be-4b6a-b9e5-dd78aca70f6b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.042814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.043449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeabf1-e264-494f-bc31-dea617a003ee None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.043902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.044444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.044888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.058890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:32.067184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:32.068275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:32.069339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:32.071463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:32.072448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.120957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.121832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.122261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.122667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.123461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.126315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.145156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 17/33] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Aug 8 02:02:31 2022] POST /identity/v3/roles => generated 219 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:32.146923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.188039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.206094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785511d-db04-41a4-b40e-b4d279181120 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.264046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.265661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.265791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.265966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.267669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:32.267981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.269445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028c01-5ce6-4fda-a732-aacdd3766491 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.283936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 17/34] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:32.290147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682f07-93a0-4724-bd66-15ecbedd742a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.290491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682f07-93a0-4724-bd66-15ecbedd742a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.290775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8682f07-93a0-4724-bd66-15ecbedd742a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.292126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 18/35] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:32.293136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8682f07-93a0-4724-bd66-15ecbedd742a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.294018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab693aa7-8fb1-42a1-8811-56e31621c4c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.329048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.348627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.349881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.350393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.350858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.352293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:32.352874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.354999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea11a-d15b-47ba-8b1e-bf0667dd280b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.367605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 18/36] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:32.370168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.370658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.371254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.399669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:32.399669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:32.430766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8682f07-93a0-4724-bd66-15ecbedd742a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.466236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.466850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.467129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.467443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.468311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.469808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be531-c99b-48bf-820f-55f0d59b23a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.483528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:32.484413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.507607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.585610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dad12-2d5f-467b-949f-3eb0fab3182f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.601932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.620094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:02:32 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:32.620234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.620820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.621134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.621368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.621562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d1ab-9143-41cc-8712-f02fcc7584bd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.621907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d1ab-9143-41cc-8712-f02fcc7584bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.622174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d1ab-9143-41cc-8712-f02fcc7584bd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.622512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.624207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 20/39] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:32.624757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d1ab-9143-41cc-8712-f02fcc7584bd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.629416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0544a-d55b-487b-966d-acd7712f2bdb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.631288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:32 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:32.632662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.632955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.633454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.652490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:32.653763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:32.744677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:32.744677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.756576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d1ab-9143-41cc-8712-f02fcc7584bd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.797861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.798476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.798757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.799026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.799753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.801987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.821051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Aug 8 02:02:32 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:32.822001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.865440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be306edf-7bb7-4806-b675-1b11084ebfff None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.884111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.897082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:32.908760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.909415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.909693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.909965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.911155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.912604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.914623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:32.921039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:32.949319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e33-91d8-4f6e-9483-cdd09d710ea9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:32.990008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:32.991104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:32.991595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:32.991939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:32.993313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:32.994780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:32.996546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 22/44] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:33.002127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:33.037973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfad492-c74f-4128-930c-dd8fa2b378c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:33.072235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:33.072927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:33.073211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:33.073613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] PATH_INFO: `/v3/domains/default/users/c7afcca3526940e6b32f29d6912ef770/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:33.075784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c7afcca3526940e6b32f29d6912ef770, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:33.077656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba2f6-c891-4bee-8b10-360ed7470c58 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:33.091244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Aug 8 02:02:32 2022] PUT /identity/v3/domains/default/users/c7afcca3526940e6b32f29d6912ef770/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:02:33.110546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfa24-daa6-4282-b335-8e01df776cb6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:33.139063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:33.147903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:33.148530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:33.148842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:33.149118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:33.149789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:33.151273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1b80d-4ee3-493e-a802-f438a8d29c24 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:33.190667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:02:33 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:02:35.096069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b52f-e087-45c5-bc44-86f5d74f4a2a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.096580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b52f-e087-45c5-bc44-86f5d74f4a2a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.096682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b52f-e087-45c5-bc44-86f5d74f4a2a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.097994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:35.103535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a23d-409c-46d2-9190-f7bc229326f3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.103912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a23d-409c-46d2-9190-f7bc229326f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.104092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a23d-409c-46d2-9190-f7bc229326f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.126268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8294a23d-409c-46d2-9190-f7bc229326f3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:35.126268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8294a23d-409c-46d2-9190-f7bc229326f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:35.200901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:35.224215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b52f-e087-45c5-bc44-86f5d74f4a2a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.226390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082a6d-6480-4b1e-ade1-b7e96f166812 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.226677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082a6d-6480-4b1e-ade1-b7e96f166812 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.226955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082a6d-6480-4b1e-ade1-b7e96f166812 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.228292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 25/49] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:02:35.233953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.234815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.235091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.252734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:35.253935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:35.269384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:35.320607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:35.332213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b52f-e087-45c5-bc44-86f5d74f4a2a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.343733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.365936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.366508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.366793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.367068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.377799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:35.382509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:35.383504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:35.384261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 25/51] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:35.385584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:35.390243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.447727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4866cd-4ab7-4b32-b394-52bd4c18627b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.482494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.483146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.483424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.483692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.484832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.486269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:35.487816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 27/52] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:35.490925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c878ee-946e-4bec-961b-0852ae96c6b7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.492559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:35.493614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.527353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.527965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.528274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.529301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.529301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:35.529561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.531063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:35.539020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:35.544818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.593235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d722e-baff-488a-9dc0-81c25aebff18 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.603212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:35.629359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.629971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.630258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.630534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.631553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.633129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:35.646369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157e72-2da6-400d-ac66-4a4271bbabef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.660044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 28/54] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Aug 8 02:02:35 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:02:35.681648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.682298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.682577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.682847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.684059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.685585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:35.688015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:35.693832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.808373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d813b-4779-4f8f-b719-648e1df072b5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.849777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.850419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.850709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.850985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.852104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.853600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bc86-868a-494b-a82f-2605422387c9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:35.855186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 29/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:35.861218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:35.893153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:35.962253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4369c3-64cf-4cec-88e1-a7e1c6e3ead3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:35.995429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:35.996040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:35.996323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:35.996596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:35.997346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.domain.id=default, user.id=c7afcca3526940e6b32f29d6912ef770) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:35.997655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:35.999657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ea522-61bc-4be4-bcdd-67084ba3fe1f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:36.005565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Aug 8 02:02:35 2022] GET /identity/v3/role_assignments?user.id=c7afcca3526940e6b32f29d6912ef770&scope.domain.id=default&role.id=c263d8337db14b7e938c9a63cd631fad => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:37.686677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1cce-f5a5-4afa-a3bf-8bf3c13830f6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:37.687161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1cce-f5a5-4afa-a3bf-8bf3c13830f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:37.687161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1cce-f5a5-4afa-a3bf-8bf3c13830f6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:37.688505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 30/58] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:37.694026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:37.694441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:37.694575 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:37.712772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:37.713955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:37.778108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:37.801696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1cce-f5a5-4afa-a3bf-8bf3c13830f6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:37.830340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:37.901645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1cce-f5a5-4afa-a3bf-8bf3c13830f6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:37.933697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:37.934311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:37.934588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:37.934855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:37.936535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:37.938053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39988b9f-8831-4c27-9a35-73f45b8233bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:37.939543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 31/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:37.945090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:37.971051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:38.041544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339542d8-bdbe-40f0-82b3-76a5b31ef684 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:38.075553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:38.076153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:38.076434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:38.076962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:38.077690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:38.079132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2ee1e-e7d3-42b4-bcbd-8296f785980a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:38.106469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 30/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:02:37 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:41.262274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a77a5-ba59-46c8-be10-3053df1c8501 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.263113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a77a5-ba59-46c8-be10-3053df1c8501 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.263530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a77a5-ba59-46c8-be10-3053df1c8501 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.265885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 32/62] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:41.271591 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce479-0d18-4738-8a21-86b11142366b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.272021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce479-0d18-4738-8a21-86b11142366b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.272138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce479-0d18-4738-8a21-86b11142366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.296863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fecce479-0d18-4738-8a21-86b11142366b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:41.298047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fecce479-0d18-4738-8a21-86b11142366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:41.312943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7704aa-84d3-4150-b434-cac80bd98e10 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.313965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7704aa-84d3-4150-b434-cac80bd98e10 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.314441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7704aa-84d3-4150-b434-cac80bd98e10 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.316622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 33/63] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:02:41.323126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926607-a841-40a1-8f3d-73a6419f7a4d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.323666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926607-a841-40a1-8f3d-73a6419f7a4d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.324133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926607-a841-40a1-8f3d-73a6419f7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.360460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f6926607-a841-40a1-8f3d-73a6419f7a4d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:41.362031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f6926607-a841-40a1-8f3d-73a6419f7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:41.402394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 31/64] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:41.424990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecce479-0d18-4738-8a21-86b11142366b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.444631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:41.485667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:41.487262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997c12-329e-4d14-b0ba-a4c4f540980c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.487819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997c12-329e-4d14-b0ba-a4c4f540980c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.488240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997c12-329e-4d14-b0ba-a4c4f540980c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.489785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 35/66] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:41.495082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.495514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.495969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.521510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:41.522763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:41.543722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:41.571783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecce479-0d18-4738-8a21-86b11142366b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:41.595517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 36/67] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:41.596379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.616042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:41.616715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.616999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.621525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.633850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:41.639611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:41.640735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:41.641516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 32/68] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:02:41.642159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.730663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4a6a-f926-47b9-8052-796dd5c5db33 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:41.744280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:41.770882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:41.771932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.772406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.772900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.782865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d0720-965b-4a69-a9f1-2bdb95449a39 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:41.785221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:41.790216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:41.791214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:41.792042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:41.794135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 37/69] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:41.795328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.816270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:41.826057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:41.827261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.827538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.827805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.837813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:41.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:41.844089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:41.844968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:41.845748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 33/70] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:41.846687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.901621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4583f-fc5e-4f65-bf3f-526948cbb4e3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:41.934995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66695218-afce-410d-8f22-e30b65503edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:41.935599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66695218-afce-410d-8f22-e30b65503edb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.936024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66695218-afce-410d-8f22-e30b65503edb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.936302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66695218-afce-410d-8f22-e30b65503edb None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.936994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66695218-afce-410d-8f22-e30b65503edb None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:41.937301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66695218-afce-410d-8f22-e30b65503edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:41.938670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66695218-afce-410d-8f22-e30b65503edb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:41.944597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb798-b259-4fcc-960d-b31488419177 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:41.950212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 38/71] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:41.955578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291f89-1daa-4cdc-a14d-96844eaae233 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.955578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291f89-1daa-4cdc-a14d-96844eaae233 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.955578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87291f89-1daa-4cdc-a14d-96844eaae233 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.955578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 39/72] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:41.957747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628e9f-c760-40d6-bb52-a8f122dadc69 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.958028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628e9f-c760-40d6-bb52-a8f122dadc69 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.958297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628e9f-c760-40d6-bb52-a8f122dadc69 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.959516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 40/73] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:41.960210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628e9f-c760-40d6-bb52-a8f122dadc69 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:41.976840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:41.981972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:41.982585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:41.982891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:41.983167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:41.983829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:41.984136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:41.985561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:41.993759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 34/74] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:41.994699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.043925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.066658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628e9f-c760-40d6-bb52-a8f122dadc69 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.094027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3551fd9-7d4e-49d2-a3c3-f2f4106b2029 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.100980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.101587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.101865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.102135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.102792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:42.103100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.104480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583696b-9d4a-4520-86ee-4e9abb420d4d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.112283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 41/75] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:42.114647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.114939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.115216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.131033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.131667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.131946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.132217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.134031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:42.135204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:42.145898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.147362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9158c-8ae1-4b61-a0bc-0bf87661e83d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.149014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 35/76] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:41 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:42.150217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.150506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.150780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.167854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:42.169081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:42.203437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 42/77] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:42.204444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.219148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.241005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 36/78] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:42.241839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.276234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.307391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b421ec-7b5b-49ff-850d-d4f4634c9940 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.342043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.342206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069bc77-d0d2-415c-9bcc-b46452cb4b52 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.342685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.342966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.343237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.344614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.346091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.347841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 43/79] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:42.348440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.380290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.380958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.381242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.381508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.382698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.384146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.385905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 37/80] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:42.386472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.437707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.457905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87e839-fcf2-4f0b-8d0e-ca0f5f08a184 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.488906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebfdf-f8fe-4212-8bd4-da4f307a9631 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.491604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.492236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.492520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.492841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.501974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.523505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.524134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.524415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.524704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.525819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.527278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.528865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 38/81] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:42.530371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.561976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.563347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.631861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472a1e-0501-49dc-b4e5-21ed91b1fad1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.648378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.660015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 44/82] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:42.661618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.665460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.666096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.666377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.666647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.677636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:42.682735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:42.683586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:42.684345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 39/83] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:42.685051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.705953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.766486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6271ab7-fa14-4e2d-a222-a73a4f3d0bff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.784670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555fbb8-4bc5-4785-9381-6ee44a3e1080 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:42.799619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.800219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.800493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.800803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.817636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:42.818184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:42.818468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:42.818747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:42.864158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.869924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.871408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.886838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:42.888293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:42.910469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:42.970499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:42.971323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:42.991799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:42.992638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.068193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6bc8-9233-4aa5-a56d-46a9b2f32031 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.069212 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.090731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682618d-c927-442e-bc17-aca83edca692 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.102063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.102662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.102936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.103204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.103836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.105299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.119611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.127505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.128163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.128422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.128718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.129826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.131261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.132902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:42 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.144481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 46/87] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:02:42 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:43.144767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.144867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.255707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46b3b-75f1-4fe2-8db6-ce4cd4c05725 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.255908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938aacb-ca68-43e4-a095-cebd5bb69cad None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.294466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.295984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.296090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.296486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.297363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:43.297671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.298688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.299121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.299338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.299625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.299907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.301635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.303070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.305678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 47/88] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.306588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.307638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 42/89] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.308319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.325658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.384768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.448122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415ce4-b13d-4418-be00-17e8731cdfda None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.456588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf1af-107c-4ad2-9174-04320c13a559 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.494249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.496270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.496565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.496899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.498141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.499758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.501118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.501659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 48/90] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.501761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.501992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.502217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.502310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.502969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:43.503275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.509609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.515812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 43/91] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=f2aede2952884054a38514133b316bb1 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.516665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.598094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.644984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46760-723f-4218-a84e-32cebdbcffe8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.645482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793820-1bfd-4716-91e1-24919416a157 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.678632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:43.686753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.687603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.688096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.688566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.689597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=c7afcca3526940e6b32f29d6912ef770) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:43.690131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.691998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.693240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.693906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.694207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.694476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.696084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.697620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.699472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 44/92] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.700142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.704912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 49/93] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/role_assignments?user.id=c7afcca3526940e6b32f29d6912ef770&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.706096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:43.850638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d1f2-e23f-4ecf-8d06-8b43acec36a8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.897743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.898578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.898862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.899139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:43.901037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:43.901355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:43.902858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:43.912231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 45/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=a865e4a5849e49a0803176776de27f92 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:43.939851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6452bc7-a68c-4284-98de-5138422f6d0c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:43.979367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:43.979999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:43.980280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:43.980555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:44.050153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:44.058931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:44.060451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:44.173825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:44.181830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:44.186566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:44.310720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2549e-96aa-48dc-905b-a7b4dd128e69 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:44.351486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:44.352129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:44.352412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:44.352784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] PATH_INFO: `/v3/projects/58066ea370c6412fac7aeb0d1d47ea95` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:44.353933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] RBAC: Authorizing `identity:get_project(project_id=58066ea370c6412fac7aeb0d1d47ea95)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:44.355411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17284043-9b27-42cc-8e97-b882978dc17a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:44.357163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:44 2022] GET /identity/v3/projects/58066ea370c6412fac7aeb0d1d47ea95 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:44.363739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:44.481720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:44.493870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450539b-cd2b-41ef-a2a6-87eaf0751af4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:44.539214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:44.539839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:44.540122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:44.540400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:44.541169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=58066ea370c6412fac7aeb0d1d47ea95, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:44.541481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:44.542944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7734fa-c8ab-4c2a-815d-806b99d6fd37 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:44.548810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:44 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=58066ea370c6412fac7aeb0d1d47ea95&role.id=f2aede2952884054a38514133b316bb1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:46.256678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5b1b-5320-4912-a7bb-940a72ca4b97 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.257723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5b1b-5320-4912-a7bb-940a72ca4b97 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.258210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5b1b-5320-4912-a7bb-940a72ca4b97 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.259764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:46.270150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.271052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.271551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.296472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:46.298037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:46.365829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc68b-2070-485d-bf69-a3389dafefa2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.366449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc68b-2070-485d-bf69-a3389dafefa2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.366957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc68b-2070-485d-bf69-a3389dafefa2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.368516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 48/99] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:46.374489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.375040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.375533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.378163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 52/100] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:46.413649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:46.415170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:46.426323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:46.527300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:46.574816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:46.577266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:46.599396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:46.623768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a62ba-84d4-42de-85ef-24e12f19e8fd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:46.707731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:46.708379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.708683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.708967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.724682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-07dc0d66-8731-4ff1-adea-eb41fe244e48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:46.730952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:46.731800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:46.734887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 53/102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:02:46.737095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0edb93-ae8b-4b9b-a021-3a841b3c0061 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0edb93-ae8b-4b9b-a021-3a841b3c0061 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.738041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0edb93-ae8b-4b9b-a021-3a841b3c0061 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.739733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 54/103] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:46.741150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11677-0ed3-43a7-8752-f34850a4be5a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.741672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11677-0ed3-43a7-8752-f34850a4be5a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.742119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11677-0ed3-43a7-8752-f34850a4be5a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.743329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106690-7a5a-4f9d-9b4a-62c2ca9acd05 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:46.743759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 55/104] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:46.745079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc11677-0ed3-43a7-8752-f34850a4be5a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:46.786584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:46.787464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.787931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.788398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.800267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9817c898-22ec-4474-ad10-b8256f42992f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:46.805592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:46.806448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:46.807213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:46.809343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 50/105] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:46.811260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bf85-1ba6-489a-94fe-ba6c50fb336a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.811845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bf85-1ba6-489a-94fe-ba6c50fb336a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.812284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bf85-1ba6-489a-94fe-ba6c50fb336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.832489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7850bf85-1ba6-489a-94fe-ba6c50fb336a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:46.834046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7850bf85-1ba6-489a-94fe-ba6c50fb336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:46.858362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc11677-0ed3-43a7-8752-f34850a4be5a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:46.894822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:46.895586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:46.896344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.896519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.896852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.897620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:46.898045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:46.899483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f303-8c4e-41d9-a2c6-e3a7e12a10b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:46.907674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 51/106] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:46.912332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 56/107] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:46.912473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.912473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.912473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.912672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace49c9f-71cd-4575-b1d8-fa0a0054cbf0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:46.912672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace49c9f-71cd-4575-b1d8-fa0a0054cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:46.912672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace49c9f-71cd-4575-b1d8-fa0a0054cbf0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:46.912672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 57/108] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:46.912672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace49c9f-71cd-4575-b1d8-fa0a0054cbf0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:46.934125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:46.939455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:46.940775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:47.020768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 52/109] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:47.020768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.040676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace49c9f-71cd-4575-b1d8-fa0a0054cbf0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.080170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.080951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.081272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.081550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.082472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:47.082792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.084323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58cc9-2174-455a-a551-eff72ec68c5e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.093891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 58/110] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:47.098249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.099751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.100034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.119019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:47.120212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:47.133572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c4ef-ed24-4eca-a993-178f6b2101c4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.158743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.171940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.172654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.173029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.173307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] PATH_INFO: `/v3/users/7c7215d207d9412390cf5647d01f9a02` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.188687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7215d207d9412390cf5647d01f9a02)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.190179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.196150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 53/111] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/users/7c7215d207d9412390cf5647d01f9a02 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:47.196150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.196404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 59/112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:47.196404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.196404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.308660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869aa1-c53f-4366-85a3-279ae3090ff1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.309167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da431d-6aba-43b5-970c-ac9c4dda816f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.345326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.346198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.346482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.346760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.347299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.347874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.347967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.348205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.348477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.349656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.351451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 54/113] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:47.352005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.359812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:47.364906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:47.365926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 60/114] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:47.366937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.411287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.439012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.473531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cfaa0-b4f0-4006-b056-c1828acb1031 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.482457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2e62c-b3eb-461e-b1a4-83eb7822ee80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.509761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.510391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.510674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.510948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.512076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.513563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.515378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 55/115] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:47.516143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.524346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.525034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.525319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.525589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.603945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.605902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.623636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151d4f-7023-473e-aaa4-b9c53ded8ae0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.642848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.666204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.667113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.667398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.667695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.674534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.680742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:47.685903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:47.686771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:47.687533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 56/116] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:47.689280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.715525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 61/117] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:47.716369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.789012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ed54-3603-4713-ad00-ebed26c879e5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.818822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7315d-7531-4348-9a12-dc449aecb6e2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.821734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.822336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.822614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.822882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.823513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.824999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.853340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:47.853901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 57/118] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:02:47 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:47.854069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.854220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.854483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.854713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.855149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:47.855456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:47.856879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c365a8b-afb3-4348-8931-c24583ed7a1c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:47.865990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:47.867284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc397-8285-4d9b-9d40-bb3dbe2afd86 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:47.867571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc397-8285-4d9b-9d40-bb3dbe2afd86 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:47.867852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc397-8285-4d9b-9d40-bb3dbe2afd86 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:47.873294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 63/120] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:47.873294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdc397-8285-4d9b-9d40-bb3dbe2afd86 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:47.899111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.902608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:47.991220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdc397-8285-4d9b-9d40-bb3dbe2afd86 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:47.993449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfa3f0-9c6c-48bf-925e-fb9874bc82dc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.028276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.028922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.029202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.030034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.030839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:48.031144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.032524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.034185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.035356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.035356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.035356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.036502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.038001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.039987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 58/121] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.040888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.042268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 64/122] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:02:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.042953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.141494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.144217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.151636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce398b9-2d07-4995-bcbc-75b862caa205 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.161367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ce113-5f99-4ba6-9e95-9cf778079e4d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.191148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.191794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.192076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.192349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.193519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.194974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76566675-23d4-419d-91a7-865bd28a36d2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.202086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.202086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.202086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.202086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.203235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.204045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.204256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.204531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.205755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.207193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.209124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 65/124] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.213581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.219335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:48.220536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:48.293177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:48.294025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.328329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd56ef-9e10-491e-9e3f-828ab6e1d133 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.366135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.366805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.367089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.367366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/6590f5037f2947a49af15a159de642f0/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.369318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, user_id=6590f5037f2947a49af15a159de642f0, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.370798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.387624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 66/126] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:02:48 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/6590f5037f2947a49af15a159de642f0/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:02:48.401727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.402935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.416790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009ee6-3ebf-4c1f-bbbc-37201d963193 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.434372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.469294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.470537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.471447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.472074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.473786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.476080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.478081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 61/127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.479058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.546354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e047-1176-4484-84fe-40ea31195117 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.594469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.595255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.595683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.596052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.596934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=7c7215d207d9412390cf5647d01f9a02) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:48.597402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.599277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.608073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 67/128] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/role_assignments?user.id=7c7215d207d9412390cf5647d01f9a02&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.608941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.625348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496cf4-8be6-4fe3-a5b8-9816b2d66638 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.693042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.693624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.693903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.694175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.698379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:48.699877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:48.705206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 62/129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:48.706097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.770776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.771433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:48.807440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09db715-97a6-4d91-9e98-dcb3509e2a6b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:48.862099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:48.862742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:48.863019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:48.863289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:48.876268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:48.882278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:48.883151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:48.884001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 68/130] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:48.890218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:48.944325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4b98-5846-4c2a-b784-c2b7f1ad5b8a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.007951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90597f2-2652-48af-b5e4-91e6fded0881 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.047327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.048003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.048283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.048559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/c7afcca3526940e6b32f29d6912ef770/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.050590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, user_id=c7afcca3526940e6b32f29d6912ef770, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.052250 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.064389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:49.064788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.065707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.066220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.066689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.068152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.070579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.072325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 69/131] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:02:48 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/c7afcca3526940e6b32f29d6912ef770/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:02:49.072749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 63/132] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:48 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:49.076749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:49.079699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:49.288539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab678214-c7bd-443d-a705-8dc8dc99a545 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.304445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:49.310627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ad7de-4ece-4437-ba16-bf38ff605963 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.358303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.359044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.359328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.359606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.360295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:49.360604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.363002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.377025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.377706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.377987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.378267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/6590f5037f2947a49af15a159de642f0/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.381263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 70/133] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:49.382231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, user_id=6590f5037f2947a49af15a159de642f0, role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.383951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.389196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:49.416477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 64/134] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:02:49 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/6590f5037f2947a49af15a159de642f0/roles/a865e4a5849e49a0803176776de27f92 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:02:49.473118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:49.516862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a276eb-b935-414d-b2a8-ad2125a97a25 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.555974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.556584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.556937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.557223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.558381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.559834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.562417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 71/135] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:49 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:49.568344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:49.708938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5aff8-3862-4364-8481-e149de08c70d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.752174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.753196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.753680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.754148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] PATH_INFO: `/v3/projects/58066ea370c6412fac7aeb0d1d47ea95` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.755529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] RBAC: Authorizing `identity:get_project(project_id=58066ea370c6412fac7aeb0d1d47ea95)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.757495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750923-078a-4bd3-a0b0-2178f1d520ab None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.760617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 65/136] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:49 2022] GET /identity/v3/projects/58066ea370c6412fac7aeb0d1d47ea95 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:49.765797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:49.912024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011928-ae2f-4fff-aca5-46dd44766c08 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:49.942940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:49.951676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:49.952676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:49.952962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:49.953233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] PATH_INFO: `/v3/projects/58066ea370c6412fac7aeb0d1d47ea95/users/6590f5037f2947a49af15a159de642f0/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:49.955128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] RBAC: Authorizing `identity:create_grant(project_id=58066ea370c6412fac7aeb0d1d47ea95, user_id=6590f5037f2947a49af15a159de642f0, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:49.956583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401cad8-cbe1-418e-8b8f-efce2f502860 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:49.981568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 72/137] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:02:49 2022] PUT /identity/v3/projects/58066ea370c6412fac7aeb0d1d47ea95/users/6590f5037f2947a49af15a159de642f0/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:02:50.271088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea00b-6ec3-4a9a-b65b-1b62d761717b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:50.271432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea00b-6ec3-4a9a-b65b-1b62d761717b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:50.271540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea00b-6ec3-4a9a-b65b-1b62d761717b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:50.273220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 66/138] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:50.278466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:50.278990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:50.280060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:50.300944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:50.302442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:50.394862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:50.432666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ea00b-6ec3-4a9a-b65b-1b62d761717b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:50.470469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:50.564603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ea00b-6ec3-4a9a-b65b-1b62d761717b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:50.606075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:50.606719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:50.606997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:50.607269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:50.609723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:50.611191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f6157-4cd9-4e8f-9cee-9d0d9d7df52e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:50.612903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 67/140] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:50.618484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:50.772615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a94fcb-57ae-4891-b42a-10c136f0cbb6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:50.793298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:50.813923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:50.814538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:50.814872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:50.815085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:50.815734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:50.817222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5428-8c05-41c5-a244-ac794f5f0955 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:50.859497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 74/141] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:02:50 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:51.057038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367196-37fd-4849-966c-0a78034736f8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.057414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367196-37fd-4849-966c-0a78034736f8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.057645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367196-37fd-4849-966c-0a78034736f8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.058950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 68/142] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:51.065307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.065858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.066319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.095107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:51.096677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:51.182941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 75/143] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:51.226571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367196-37fd-4849-966c-0a78034736f8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:51.353628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:51.362859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367196-37fd-4849-966c-0a78034736f8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:51.413538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:51.414256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.414590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.414868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.437358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:51.442265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:51.443099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:51.443866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 69/144] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:51.449392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:51.558031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58870b51-706e-4a9c-b06b-17a701c0d055 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:51.566171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:51.595092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:51.595700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.595976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.596244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.597129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:51.597428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:51.598792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b40739-26cb-4848-9fa4-5e2d3729ae8a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:51.607999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 76/145] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:51.613526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:51.734979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11d178-b571-4d3a-a1fc-53016408f697 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:51.769633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccffb-f747-4d60-80d0-b2ea7461af28 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.769972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccffb-f747-4d60-80d0-b2ea7461af28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.770253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccffb-f747-4d60-80d0-b2ea7461af28 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.771608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 77/146] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:51.779242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:51.780001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.780284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.780545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.782903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:51.784394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:51.786153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:51.786455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:51.786704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:51.806285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 70/147] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:51 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:51.814199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:51.818804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:51.825281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:51.849592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:51.921491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 78/148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:51.944222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:51.969593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f14c1-6d89-4420-9286-52360c97b4f8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.018702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.019324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.019602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.019956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.075101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:52.085744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719cf3-2bfb-425d-b081-a7b0d71d6e5d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.145637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.147107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.151373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.152010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.152325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.152592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.172176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:52.178308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:52.179196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:52.180000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:52.181320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 79/149] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:52.189488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:52.199888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:52.337562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 71/150] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:02:52.342775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:52.378641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ecab-7213-4ade-ae7a-4c462e09fee0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.460678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.461298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.461551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.461816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.462491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:52.462788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.464167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.471180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16511bc-4623-4eb0-9ce6-d8dcb051c71b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.479870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 80/151] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:52.485763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:52.497468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:52.518370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.519024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.519294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.519560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.521513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:52.521638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.523010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.524790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 72/152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:52 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:52.531954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:52.647442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75417da-781e-4feb-b954-ae4e7279cb9f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.680778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2828-ec3e-412e-87f5-e27032987bd4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.684048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.684673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.684958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.685227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.686882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:52.687335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.688811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.695386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 73/153] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:52 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=f2aede2952884054a38514133b316bb1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:52.749460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.750259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.750543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.750816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] PATH_INFO: `/v3/users/7c7215d207d9412390cf5647d01f9a02` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.752082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] RBAC: Authorizing `identity:get_user(user_id=7c7215d207d9412390cf5647d01f9a02)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.753608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027af6a-2ff0-4e0a-b3e3-4ac5fdcaa8bf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.755640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 81/154] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:52 2022] GET /identity/v3/users/7c7215d207d9412390cf5647d01f9a02 => generated 289 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:52.761272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:52.824993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacab32-a88d-48e5-bd0d-68c923e21297 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.825322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacab32-a88d-48e5-bd0d-68c923e21297 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.825553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacab32-a88d-48e5-bd0d-68c923e21297 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.827528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 82/155] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:52.832732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c7e8-5856-4b49-b58d-ae3858bc84aa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.833019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c7e8-5856-4b49-b58d-ae3858bc84aa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.833293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c7e8-5856-4b49-b58d-ae3858bc84aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.841391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:52.877698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fb19c7e8-5856-4b49-b58d-ae3858bc84aa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:52.878927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb19c7e8-5856-4b49-b58d-ae3858bc84aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:52.892809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6fba8-de8e-49aa-988a-563ba1a140e4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:52.929911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:52.930875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.931301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.931705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.933030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:52.934633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ac59d-c575-40ec-96fd-0b329dd378a5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:52.937321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 74/156] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:52 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:52.938702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d074-dd6c-4e94-90d1-c5a359d64e4f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:52.939118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d074-dd6c-4e94-90d1-c5a359d64e4f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:52.939520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d074-dd6c-4e94-90d1-c5a359d64e4f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:52.940959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 75/157] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:52.942464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96d074-dd6c-4e94-90d1-c5a359d64e4f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.047164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:53.048575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.048884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.049151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.086414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:53.087612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:53.122235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:53.182378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96d074-dd6c-4e94-90d1-c5a359d64e4f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:53.218603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:53.231878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:53.232755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.233208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.233622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/7c7215d207d9412390cf5647d01f9a02/roles/0fbc17a20e70477c94af817864ff0cd5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.235700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, user_id=7c7215d207d9412390cf5647d01f9a02, role_id=0fbc17a20e70477c94af817864ff0cd5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:53.237439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:53.238811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 84/159] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:53.240099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.258118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 76/160] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:02:52 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/users/7c7215d207d9412390cf5647d01f9a02/roles/0fbc17a20e70477c94af817864ff0cd5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:02:53.275005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.430521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211179e9-46a6-4f78-875c-3a333bd7a53f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:53.488763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658344d-d377-40be-bb44-ab65c057ada1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:53.522832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:53.523511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.523761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.524044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.540115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0766abc3-9ab5-43ec-8c34-7868f216afee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:53.545446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:53.546326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:53.547100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 77/161] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:02:53.548223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4559f-813e-41a7-a9ec-d017e1d03c57 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.548313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4559f-813e-41a7-a9ec-d017e1d03c57 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.548673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4559f-813e-41a7-a9ec-d017e1d03c57 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.549783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 78/162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:53.554579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4559f-813e-41a7-a9ec-d017e1d03c57 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.573443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:53.574150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.574436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.574707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.587623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bb20338d-df93-4e0b-9096-9d48a81ea1c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:53.592852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:53.593720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 85/163] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:53.595805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.597525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.597525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.610982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:53.616756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:53.618073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:53.653018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:53.745697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 86/164] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:53.746509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.764908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4559f-813e-41a7-a9ec-d017e1d03c57 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:53.833088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:53.834913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:53.836920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:53.837409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:53.839584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:53.840134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:53.842408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:53.864148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 79/165] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:53.865328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:53.942128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7139e2-7767-44f7-8118-17822531a77c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.021475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.022493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.022962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.023431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.024306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:54.024856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:54.026538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:54.029326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.040959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 87/166] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:54.042018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:54.088789 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99d8f-a9ec-4bdc-82be-be6b468ed0bd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.096982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.191947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.192584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.192885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.193150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.217056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:54.223398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:54.224556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:54.225384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 80/167] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:54.226696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:54.265371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb85a5-7606-498c-83f1-713487ab2023 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.331451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.332019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.332296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.332563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] PATH_INFO: `/v3/users/c7afcca3526940e6b32f29d6912ef770` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.336138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] RBAC: Authorizing `identity:get_user(user_id=c7afcca3526940e6b32f29d6912ef770)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:54.337668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:54.339484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 88/168] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:54 2022] GET /identity/v3/users/c7afcca3526940e6b32f29d6912ef770 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:54.340305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:54.484074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.496393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe27ed-bf0e-4b4c-8ca9-e22fa4236ead None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.558928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966920-6595-4f8e-9dd6-e44db85a2b9c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.571280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.571934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.572214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.572493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.573712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:54.575183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:54.577673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 81/169] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:54 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:54.578459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:54.611608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.649364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.650222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.650646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.651089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.651915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:54.652376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:54.653920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:54.674544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 89/170] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:54.675629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:54.683948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72503f0-773a-44c3-9790-c0a28afb6b82 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.720260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.720923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.721203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.721484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:54.806049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:54.807556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:54.876996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.910332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10f79-7889-47c8-bd4f-5b32e8d1fa22 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:54.966056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:54.977725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:54.978342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:54.978620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:54.978893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.016543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:55.017761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.126067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.127947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85623-41a5-47eb-80fc-30885b871aa8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.210766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aec264-18d2-46c7-b2cf-3a61c13be7a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.244105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.252206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.252872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.253150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.254000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] PATH_INFO: `/v3/users/6590f5037f2947a49af15a159de642f0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.255159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] RBAC: Authorizing `identity:get_user(user_id=6590f5037f2947a49af15a159de642f0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.256609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.258403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 83/172] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/users/6590f5037f2947a49af15a159de642f0 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:55.263937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.317777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 90/173] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:55.319075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8e9d-8163-4434-b043-e8a06d67fc48 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.320098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8e9d-8163-4434-b043-e8a06d67fc48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.320098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8e9d-8163-4434-b043-e8a06d67fc48 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.321833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 91/174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:55.322628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf8e9d-8163-4434-b043-e8a06d67fc48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.383610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.467467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5531-d58f-4234-8110-cbcc074da501 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.508112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf8e9d-8163-4434-b043-e8a06d67fc48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.512018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.512761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.513114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.513808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.515078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.516672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.518973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 84/175] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:55.520401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.551283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.552616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.553377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.553828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.609581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.640213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.642390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569284-1a83-43fc-af54-8ffaa8321947 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.643997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee65f-b213-467f-871b-d4504bc2cb44 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.676904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.679458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.680129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.680405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.680689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.681804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.683253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdf38-9140-4c34-99cb-e01514995486 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.684921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 85/176] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:55.686121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ee71-7fe1-4314-b802-9c2948b9cce9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.686403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ee71-7fe1-4314-b802-9c2948b9cce9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.686676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ee71-7fe1-4314-b802-9c2948b9cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.704388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fbb7ee71-7fe1-4314-b802-9c2948b9cce9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:55.705612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fbb7ee71-7fe1-4314-b802-9c2948b9cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:55.765780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 92/177] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:55.767460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac0b4-e986-4d9c-9641-2a55b2cff900 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.767921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac0b4-e986-4d9c-9641-2a55b2cff900 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.768365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac0b4-e986-4d9c-9641-2a55b2cff900 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.769859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 93/178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:55.772674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac0b4-e986-4d9c-9641-2a55b2cff900 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.786673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 86/179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:55.787912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3dca-b15c-45de-9a6e-f812f42293a6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.788190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3dca-b15c-45de-9a6e-f812f42293a6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.788457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3dca-b15c-45de-9a6e-f812f42293a6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.789844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 87/180] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:55.794290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3dca-b15c-45de-9a6e-f812f42293a6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.872629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.895622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac0b4-e986-4d9c-9641-2a55b2cff900 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.912319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3dca-b15c-45de-9a6e-f812f42293a6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:55.926759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:55.936092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.936922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.937347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.937615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.938339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=c7afcca3526940e6b32f29d6912ef770) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:55.938684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.940166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.946655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 94/181] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/role_assignments?user.id=c7afcca3526940e6b32f29d6912ef770&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:55.947525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:55.958991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:55.959972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.960452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.960952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:55.961935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:55.962546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:55.964381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b8612-77a9-47d1-ae22-30d04fb43112 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:55.972667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 88/182] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=a865e4a5849e49a0803176776de27f92 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:55.975560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6de7-62b7-4c73-adef-01f80dbb9fd3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:55.976472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6de7-62b7-4c73-adef-01f80dbb9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:55.976993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6de7-62b7-4c73-adef-01f80dbb9fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.002522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c25f6de7-62b7-4c73-adef-01f80dbb9fd3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:56.004942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c25f6de7-62b7-4c73-adef-01f80dbb9fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:56.098135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 89/183] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:56.100238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10f7f-dd27-4a6b-ada8-b6d1a7b7316f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.100816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10f7f-dd27-4a6b-ada8-b6d1a7b7316f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.101296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10f7f-dd27-4a6b-ada8-b6d1a7b7316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.109719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699122-ced2-4182-82f3-b655140a5402 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.121728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bad10f7f-dd27-4a6b-ada8-b6d1a7b7316f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:56.123362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bad10f7f-dd27-4a6b-ada8-b6d1a7b7316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:56.168214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.169308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.169889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.170386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] PATH_INFO: `/v3/projects/58066ea370c6412fac7aeb0d1d47ea95` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.171990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] RBAC: Authorizing `identity:get_project(project_id=58066ea370c6412fac7aeb0d1d47ea95)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:56.173801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:56.175996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 95/184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:55 2022] GET /identity/v3/projects/58066ea370c6412fac7aeb0d1d47ea95 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:56.177068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.200509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.218187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 90/185] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:56.219495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7480f-3c85-4e87-8070-eb1d1c3a2828 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.219870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7480f-3c85-4e87-8070-eb1d1c3a2828 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.220147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7480f-3c85-4e87-8070-eb1d1c3a2828 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.221445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 91/186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:56.222134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7480f-3c85-4e87-8070-eb1d1c3a2828 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.255171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.308128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145fa42-75af-4b57-ada4-53b8b1998eef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.343183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.343818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.344097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.344367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.349827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7480f-3c85-4e87-8070-eb1d1c3a2828 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.355274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:56.361178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:56.362232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:56.363294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 96/187] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:56.365165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.386451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.387090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.387365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.387636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.388779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:56.390222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839072a-7517-4790-b116-f12f00116e68 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:56.395465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 92/188] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:56.395465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.395465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.395465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.411132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:56.412325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:56.466077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.472872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6fe4-2f49-4804-9437-2683cce324f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.480885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 93/189] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:02:56.481704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.499187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.514005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.514601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.514877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.515136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.515847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=58066ea370c6412fac7aeb0d1d47ea95, user.id=6590f5037f2947a49af15a159de642f0) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:56.516156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:56.517644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:56.523258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 97/190] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/role_assignments?user.id=6590f5037f2947a49af15a159de642f0&scope.project.id=58066ea370c6412fac7aeb0d1d47ea95&role.id=f2aede2952884054a38514133b316bb1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:56.524026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.594714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac92f-b819-4aca-91ff-23846c6ba6ed None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.635821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.637345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.637774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.638306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.642713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5e0-b0b4-44bc-9c0e-0def461d8f57 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.652417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:56.658961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:56.659989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:56.660834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 94/191] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:56.666698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.680488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.680996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.681264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.681606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.682271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:56.682568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:56.683934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:56.692734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 98/192] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:56.697730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.725200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.753819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.783834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc06a7-6dcb-48d4-afab-14c99ca4deb7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.808145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a30c0-d349-443d-9dcc-98c857e21444 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.819522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.820120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.820390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.820672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.821311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:56.822740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:56.842692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:56.843329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:56.843591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:56.843855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:56.844239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 95/193] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:02:56 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:56.845084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.863648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:56.869223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:56.870213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:02:56.871020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 99/194] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:56.877165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:56.971331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f458-e3ae-40c7-a80b-8332f26bd61f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.973771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:56.989801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5336d-a79f-4ffc-bee1-51ef82860f80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:56.999072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.014705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.015327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.015604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.015871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.016578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:57.016935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.018331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.027763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 96/195] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:57.028577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.033397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.033947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.034226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.034496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.051218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.052710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.054550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 100/196] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:56 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:57.055164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.178027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453eb8-d951-40a4-8111-bcd71d2a6b4a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.213322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700c11-7bf4-4fb2-ad37-006e305232d5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.221435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.224050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.224907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.225456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.226689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:57.227307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.228962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.239494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 97/197] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:57.245004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.260679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.260679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.260679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.260679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.261082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.264704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.264704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 101/198] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:57.265657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.303750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.339283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.448405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9edd5-796d-42bc-9507-7d28ccb88c2b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.453593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f855-6a4f-474f-8014-a1f860cfd122 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.493055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.494161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.494727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.495203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] PATH_INFO: `/v3/users/7c7215d207d9412390cf5647d01f9a02` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.496912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7215d207d9412390cf5647d01f9a02)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.499231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.501479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 102/199] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/users/7c7215d207d9412390cf5647d01f9a02 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:57.502628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.572220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531392-afd0-4326-9114-997debec91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.572912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531392-afd0-4326-9114-997debec91da None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.575202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531392-afd0-4326-9114-997debec91da None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.575486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531392-afd0-4326-9114-997debec91da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.634760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62052675-c79d-4ef4-87d4-5b1402d47a39 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.636957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.700450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:57.702905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:57.703518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:57.703979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:57.716109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531392-afd0-4326-9114-997debec91da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.718603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531392-afd0-4326-9114-997debec91da None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.754083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.792119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:57.794391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:57.852514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 98/200] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:57.854801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531392-afd0-4326-9114-997debec91da None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.921333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:57.930775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 103/201] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:57.931873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:57.965098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531392-afd0-4326-9114-997debec91da None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:57.992836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:58.001384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.001992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.002256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.002533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.045487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5a03-d620-4f36-9071-3ea9ad4f89c1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.071519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.073013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.085410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.086394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.086873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.087381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.088848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.090544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.092959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 104/202] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:58.093939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:58.170525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:58.186421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 99/203] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:02:58.187356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:58.210274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676423-119d-416f-902d-be37cb77f295 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.218242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:58.251217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.252246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.252777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.253343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.254797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.256428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.258545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 105/204] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:58 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:58.264860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:58.294048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b02ed3-8ee2-4b27-a5e9-cfbce22fe178 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.329450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.329980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.330255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.330533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.331302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=348f76f06aff4d6bad33eed79403beb3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:58.331604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.333176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.344983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 100/205] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:58 2022] GET /identity/v3/role_assignments?user.id=348f76f06aff4d6bad33eed79403beb3&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:58.345964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:58.375512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c23c-a9e3-4d6c-98ee-cf9e43c99eb5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.427570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.436045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.436045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.436045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.438938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.442334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.448906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 106/206] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:02:58 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:58.451995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:58.461020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:58.572828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:58.590493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a94c1-d8fc-440a-9644-70842c6d12e3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.658056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.660100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.660391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.660772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.661423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=348f76f06aff4d6bad33eed79403beb3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:58.661730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.663186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac014-75a6-4ddd-a929-f9d4ab843acd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.667657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c67e-eb89-4675-a95b-20dc42e46dcb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:58.681309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:58 2022] GET /identity/v3/role_assignments?user.id=348f76f06aff4d6bad33eed79403beb3&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=a865e4a5849e49a0803176776de27f92 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:58.728449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:58.729175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:58.729377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:58.729639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:58.730380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, scope.project.id=6264bfc23acf4a2d969b177df67b7239, user.id=7c7215d207d9412390cf5647d01f9a02) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:58.730684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:58.736837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fc43a-3e70-45e5-8b49-46aae7615f65 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:58.743710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:02:58 2022] GET /identity/v3/role_assignments?user.id=7c7215d207d9412390cf5647d01f9a02&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:59.196009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a00a-d292-473f-b695-28efcf4cd150 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.196516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a00a-d292-473f-b695-28efcf4cd150 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.196617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a00a-d292-473f-b695-28efcf4cd150 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.197146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7afc-d205-4c32-8f4a-82b3a5567ffa None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.197428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7afc-d205-4c32-8f4a-82b3a5567ffa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.197702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7afc-d205-4c32-8f4a-82b3a5567ffa None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.198168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:02:59.199170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 108/210] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:02:59.203696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.203980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.204253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.208933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.209212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.209484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.227365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:59.228569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:59.234730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:02:59.235917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:02:59.316798 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 103/211] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:59.327667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:02:59.331662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:59.339001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:59.351722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:59.458774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:59.477972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401875-06a7-4512-8b0e-26db2c41dd70 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:59.481569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb0a5a-f54c-4a39-8123-2aa536353185 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:59.518960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:59.519721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.520002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.520282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.521766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:59.523946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:59.531208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 110/213] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:02:59.531375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:59.531375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.531375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.532031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.532195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:59.546169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:02:59.551331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:02:59.552308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:02:59.553152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:02:59.557532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 104/214] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:02:59.558406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:59.616719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:59.654887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031f7c-b63b-45fd-83ec-a9e0ce450417 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:59.675016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131dd6-271f-46d6-83ce-1b6d046f8216 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:59.692753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:59.693664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.694095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.694502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.695276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:59.696957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:59.710420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:59.711046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.711389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.711649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.712512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:02:59.712862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:59.714321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:59.721869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 111/215] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:02:59 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:02:59.728270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 105/216] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:59.729221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:02:59.742276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:02:59.843572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38411cb-a232-4f25-93f9-6a8fb8dff3b2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:02:59.880430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:02:59.881101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:02:59.881380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:02:59.881651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] PATH_INFO: `/v3/users/818c512cdc654606a02f3717dc07f633` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:02:59.897054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] RBAC: Authorizing `identity:get_user(user_id=818c512cdc654606a02f3717dc07f633)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:02:59.898549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:02:59.900537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 106/217] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:02:59 2022] GET /identity/v3/users/818c512cdc654606a02f3717dc07f633 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:02:59.907082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:00.022645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f902e8-9f72-4ede-84c2-3b4e812ed8a0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:00.051404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:00.068528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:00.069304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.069581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.069848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.148371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:00.149884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:00.261935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 112/218] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:00.268215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:00.346003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:00.394754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f021-d2f4-4161-af36-c2873e15a552 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:00.450836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:00.451553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.451782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.452029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.453228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:00.454709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385d78c-f5d9-4f28-892b-92a38a4c8189 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:00.456729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 107/219] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:00 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:00.462727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:00.500124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:00.595549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f766-9ad2-4d23-8246-7de54402b1f6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:00.603172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7991a-5cc7-48d7-b772-e4b93241b6f9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.603417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7991a-5cc7-48d7-b772-e4b93241b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.603654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7991a-5cc7-48d7-b772-e4b93241b6f9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.605160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 108/220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:00.610368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.610715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.610995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.633844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:00.635065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:00.679958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:00.680575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.680883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.681153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.681880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=818c512cdc654606a02f3717dc07f633) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:00.682188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:00.683636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:00.695934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 113/221] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:00 2022] GET /identity/v3/role_assignments?user.id=818c512cdc654606a02f3717dc07f633&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=f2aede2952884054a38514133b316bb1 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:00.755378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:00.787946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:00.887933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:00.902084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43be773-2bc4-45ce-b268-61f75d3d0b66 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:00.940044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:00.940807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.940985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.941256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.952303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-af6b99dc-f221-4a4c-b1c9-96a54b71b0e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:00.957640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:00.958530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:00.959343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 114/223] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:00.964867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:00.988981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f6c-ab8f-4ad2-b162-18c94fd0129c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.989305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f6c-ab8f-4ad2-b162-18c94fd0129c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.989524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f6c-ab8f-4ad2-b162-18c94fd0129c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:00.991279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 115/224] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:00.996482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:00.996774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:00.997049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.020726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:01.021941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:01.059879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.100927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 116/225] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:01.126004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.135218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dd7c7-e357-4103-bf06-eae958d9d15e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.204592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.205150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.205428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.205699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.206365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:01.206668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.208038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.230323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 110/226] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:01.238051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.273045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.320833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc134b8-e18a-4a07-b81b-52c706732bd7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.370743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017662b-c7f5-4d62-939d-2389752b0125 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.371254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.371682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.371953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.372267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.383195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:01.388031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:01.389466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:01.390259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 117/227] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:01.397204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.419437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.442252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.442944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.443220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.443487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.445820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.449422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.454351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 111/228] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:01.459531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.599802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c497-4d6f-4a4a-9c6c-b101ea9a3459 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.639642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d730e-5d64-44d6-a031-917aa020d298 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.656678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.656678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.656678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.656678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.657056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:01.657056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.657056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.657056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.673703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 118/229] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:01.674599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.711772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.712424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.712724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.713091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.715999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.717805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.724513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 112/230] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:01.725332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.795377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3e70-1f20-4b87-add1-b94d4f68c0a9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.833644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.834276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.834562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.834820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.836007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.837478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.839057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.840487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 119/231] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:01.846863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:01.916634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:01.917580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862547e9-061e-4287-8876-0127d7fc2c13 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.955876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938a21-9f6e-4416-a372-26ec288a1155 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:01.985134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.985999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.986288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.986563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/348f76f06aff4d6bad33eed79403beb3/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.988966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, user_id=348f76f06aff4d6bad33eed79403beb3, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.990518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0c0a6-cdc1-402b-a57a-5af584db19b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:01.994796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:01.995435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:01.995714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:01.995982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:01.997169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:01.999448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:02.001246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 120/232] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:01 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:02.007166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:02.014156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 113/233] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:01 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/348f76f06aff4d6bad33eed79403beb3/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:02.125365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6541b5-980e-49ef-b967-42ec21b3b1a5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:02.162761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:02.163442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.163720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.163994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/348f76f06aff4d6bad33eed79403beb3/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.166268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, user_id=348f76f06aff4d6bad33eed79403beb3, role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:02.167725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d147316-fe82-4ecb-8380-b7e049f6dfb2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:02.170776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:02.189627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 121/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:02 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/348f76f06aff4d6bad33eed79403beb3/roles/a865e4a5849e49a0803176776de27f92 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:03:02.553464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ef225-c485-47fa-9af3-3dbac9d5f849 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.554512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ef225-c485-47fa-9af3-3dbac9d5f849 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.555000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ef225-c485-47fa-9af3-3dbac9d5f849 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.556554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 114/235] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:02.562446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.562731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.563009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.592862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:02.594123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:02.627200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8639-e19c-4f30-96a3-15fef5e25f7c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.627813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8639-e19c-4f30-96a3-15fef5e25f7c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.628316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8639-e19c-4f30-96a3-15fef5e25f7c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.629898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 115/236] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:02.635161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.635677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.636158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.654196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:02.655815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:02.689826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 122/237] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:02.725896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:02.736757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 116/238] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:02.755294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:02.809625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:02.861556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981a65-00ac-4ff7-9689-452637cf12e3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:02.887524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:02.887741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc75ddd-e743-4d77-861d-dc385cb92e26 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:02.925374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:02.926006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.926284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.926557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.926884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:02.927614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:02.927979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:02.928343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:02.929576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:02.931192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:02.937663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 117/239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:02.938939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:02.961053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:02.965883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:02.967456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:02.968252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 123/240] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:02.978935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:03.098233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96d66-09e6-4d61-9dac-a3950e9e1ee3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.137040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:03.173154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.173766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.174038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.174304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.174961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:03.176416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:03.215647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f292a-999c-40e0-aeb2-5ff0ecbcae8c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.224458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 118/241] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:02 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:03:03.277438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.278048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.278323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.278592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.279469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:03.279812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:03.281236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b11f-642e-42a3-9366-c300e840b9d1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:03.296802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 124/242] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:03.304748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:03.358026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657ee7-0238-4758-9033-7c06e6247230 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.358437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657ee7-0238-4758-9033-7c06e6247230 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.358658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657ee7-0238-4758-9033-7c06e6247230 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.360377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 125/243] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:03.370062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.370376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.370618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.410630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:03.414379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:03.469015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:03.494369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882a6e4-584e-4ba6-8810-88c87e7ddb57 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.501799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 126/244] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:03.525956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:03.546640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.547781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.548416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.548797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] PATH_INFO: `/v3/users/1f419dae78b243379833a826e1acd3f2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.575247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] RBAC: Authorizing `identity:get_user(user_id=1f419dae78b243379833a826e1acd3f2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:03.576883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:03.579210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 119/245] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:03 2022] GET /identity/v3/users/1f419dae78b243379833a826e1acd3f2 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:03.587870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:03.642063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:03.681178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acfc82-9a7e-4d87-bd30-7dc03aec1d89 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.741076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.742589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.743176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.743827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.749256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5318-f4a1-4648-a038-da3ae27cb63d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.761976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:03.768822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:03.770383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:03.771930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:03.779339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 127/246] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:03.783768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:03.815472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.816108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:03.816379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:03.816692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:03.835640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:03.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a60ec-1ac7-455f-97ab-f35b6d420f63 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:03.932830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:03.934321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:03.985823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:03.998269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:03.999616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.000088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.000559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.001497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:04.002109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.003825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.017040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 128/247] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:04.020036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:04.061850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:04.067733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:04.189478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:04.200584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17927-a8d8-48f6-8649-aeed17d733ab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:04.254106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d6d4-0f9b-4b26-a74f-72ce7540b911 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:04.310823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:04.311993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.312598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.313102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.313434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:04.314093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.314475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.314744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] PATH_INFO: `/v3/users/818c512cdc654606a02f3717dc07f633` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.315442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.317152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.319064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 121/249] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:04 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:04.324013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] RBAC: Authorizing `identity:get_user(user_id=818c512cdc654606a02f3717dc07f633)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.324013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.324013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 129/250] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:04 2022] GET /identity/v3/users/818c512cdc654606a02f3717dc07f633 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:04.325442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:04.329369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:04.331861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:04.444618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486953c3-dbfe-47e6-b415-9438ebbfd02b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:04.489609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:04.490604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.492546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.493197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.494346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=1f419dae78b243379833a826e1acd3f2) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:04.495530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.497404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.511912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 122/251] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:04 2022] GET /identity/v3/role_assignments?user.id=1f419dae78b243379833a826e1acd3f2&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:04.558070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56f63-34bf-49b3-b6ee-7df5ca5366c0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:04.604403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:04.605413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.605891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.606401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.608362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.610044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45e82-4060-4418-bfc7-06d996fefdc7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.612209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 130/252] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:04 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:04.618045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:04.724542 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:04.770970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b55bf-bdac-4006-94f8-0d13676e43ea None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:04.818937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:04.819620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.819895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.820165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/818c512cdc654606a02f3717dc07f633/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.822170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, user_id=818c512cdc654606a02f3717dc07f633, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:04.823644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126da7cc-c7db-4738-83c1-2d830f087a0d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:04.848424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:04 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/818c512cdc654606a02f3717dc07f633/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:03:04.869308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963666d-af1f-453c-a26a-13721a169b79 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.869967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963666d-af1f-453c-a26a-13721a169b79 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.870442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963666d-af1f-453c-a26a-13721a169b79 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.872160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 131/254] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:04.878225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb888a1-83e4-4ce9-a1ff-204e848a6165 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:04.878514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb888a1-83e4-4ce9-a1ff-204e848a6165 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:04.878772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb888a1-83e4-4ce9-a1ff-204e848a6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:04.900584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6fb888a1-83e4-4ce9-a1ff-204e848a6165 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:04.901881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6fb888a1-83e4-4ce9-a1ff-204e848a6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:04.992345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 124/255] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:05.027947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963666d-af1f-453c-a26a-13721a169b79 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.039033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7442-fa48-4016-b6ca-08b9d6019489 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.039361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7442-fa48-4016-b6ca-08b9d6019489 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.039571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7442-fa48-4016-b6ca-08b9d6019489 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.040943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 125/256] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:05.047442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.048024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.048522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.068964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:05.070497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:05.099538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:05.130874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:05.150928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 126/257] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:05.175457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.232458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963666d-af1f-453c-a26a-13721a169b79 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.282069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae967fe-6ca4-4d05-956d-c618e1b6a02f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.293338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.293984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.294265 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.295489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.329432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.330806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.331311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.331806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.348671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:05.350915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:05.351805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:05.352628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 132/258] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:05.358440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.358833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:05.364301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:05.369423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:05.370263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:05.372893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 127/259] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:05.379996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.457779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:05.507118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb6042-c5ba-482e-a0e0-b0163a976157 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.548767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.549835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.550318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.550792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.551661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:05.552163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:05.556026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:05.569311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 128/260] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:05.576636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.585207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3324-cea8-420d-bc64-00afcd6af6d3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.601089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:05.662756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.663388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.663655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.663927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.664604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:05.664938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:05.666320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:05.675413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 133/261] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:05.680524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.803111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67086-ac12-4e85-afd9-0dd249f54586 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.813298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:05.843734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.844382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.844674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.844961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:05.846112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:05.847570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:05.849721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 129/262] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:05.856343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:05.916398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf13c-43ea-4f01-abb2-ce041283d147 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.971678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654cbe-e1fa-4d8d-bb37-3d9c52bd4249 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:05.996761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:05.997949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:05.998227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:05.999169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] PATH_INFO: `/v3/users/348f76f06aff4d6bad33eed79403beb3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.001039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] RBAC: Authorizing `identity:get_user(user_id=348f76f06aff4d6bad33eed79403beb3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.002486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.005214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 134/263] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/users/348f76f06aff4d6bad33eed79403beb3 => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:06.009316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:06.026572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.027248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.027523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.027792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.069048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:06.106588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:06.152051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.153562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.214386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ace75-510c-48a3-95f6-981711a72a57 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:06.261522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.262146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.262430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.262707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.332828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 130/264] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:06.339750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.341932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.346219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:06.371895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:06.452376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 135/265] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:03:06.458115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:06.477024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:06.540003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce26a-bfc6-4eff-850d-4a205bfc3c29 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:06.632541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.633888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.634368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.634838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.638534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.640307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.642221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 131/266] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:06 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:06.648678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:06.676149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af38b-254a-459c-9d61-74992850f5ab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:06.717215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:06.744162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.744855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.745132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.745395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.746619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.748423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.750033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 136/267] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:06 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:06.756047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:06.882151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df850e-c64b-44ac-8637-288af6733571 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:06.933537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1239096-5d79-45c8-90fc-9d74f369b69d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:06.935424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a757472-28e6-434b-a077-876783384588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.937056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757472-28e6-434b-a077-876783384588 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.937341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757472-28e6-434b-a077-876783384588 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.937615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757472-28e6-434b-a077-876783384588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.938347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a757472-28e6-434b-a077-876783384588 None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=348f76f06aff4d6bad33eed79403beb3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:06.938657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a757472-28e6-434b-a077-876783384588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.940126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a757472-28e6-434b-a077-876783384588 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:06.948098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 132/268] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:06 2022] GET /identity/v3/role_assignments?user.id=348f76f06aff4d6bad33eed79403beb3&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=a865e4a5849e49a0803176776de27f92 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:06.949361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fe56-2128-4ff1-bced-56787607c91a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.949685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fe56-2128-4ff1-bced-56787607c91a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.949982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fe56-2128-4ff1-bced-56787607c91a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.951645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 133/269] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:06.952592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4c01-263f-4589-9b7c-9d5dc32d94a3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.952991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4c01-263f-4589-9b7c-9d5dc32d94a3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.953348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4c01-263f-4589-9b7c-9d5dc32d94a3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.955131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 134/270] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:06.962210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.962856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.963359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.989086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:06.989725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:06.990006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:06.990278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:06.991007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=348f76f06aff4d6bad33eed79403beb3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:06.991314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:06.996669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada2288-c4b6-458f-9e03-db48b526902c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:07.004681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 137/271] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:06 2022] GET /identity/v3/role_assignments?user.id=348f76f06aff4d6bad33eed79403beb3&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:07.006053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.006343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.006618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.009763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:07.010998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:07.015392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.049931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:07.051177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:07.128936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 135/272] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:07.155133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.174220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.218310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 138/273] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:07.269182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7c1e0-b4df-4b87-b425-2edf35d7bb28 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.272676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.307427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.308179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.308458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.308773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.310573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:07.312081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:07.314193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 136/274] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:07.320218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.337005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.438540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53510-ef75-4980-bdf2-e795b6805720 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.449647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae980-bea8-40fa-89e0-5ef9cdb30350 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.485311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.485846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.486132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.486399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.487051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:07.488537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:07.496901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.498249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.498829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.500113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.517267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 137/275] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:07 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:03:07.518441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-be47c578-0818-4eac-b47b-7032382414a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:07.523954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:07.526341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:07.527148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:07.530991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 139/276] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:07.537621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.583804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ee59-8318-4f05-9871-0683771e53a8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.584114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ee59-8318-4f05-9871-0683771e53a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.584354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ee59-8318-4f05-9871-0683771e53a8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.587182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 140/277] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:07.592213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.592677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.592782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.624450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:07.625781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:07.657102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.661372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9265e1-7d97-4dc4-962e-df166460faf3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.674959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.705165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.705165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.705165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.705563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.705645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 141/278] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:07.706132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:07.706437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:07.707833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:07.717231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 138/279] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:07.722617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.730163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.856251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc6c8-5931-402b-b71f-c4157a926bad None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.874863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb686d-ffb2-44d3-aa50-778a04f08920 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:07.903488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:07.907707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.908699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.908893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.909565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] PATH_INFO: `/v3/users/63831ee388ec4f22843d5ebb4621f000` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.918099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:07.918823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.919110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.919511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.926007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] RBAC: Authorizing `identity:get_user(user_id=63831ee388ec4f22843d5ebb4621f000)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:07.927551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ba45-918f-454a-b785-436829b91696 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:07.929556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 142/280] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/users/63831ee388ec4f22843d5ebb4621f000 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:07.930982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86dc3-a7da-426c-9fe3-b4d7d7985bab None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.931264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86dc3-a7da-426c-9fe3-b4d7d7985bab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.931534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86dc3-a7da-426c-9fe3-b4d7d7985bab None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.932866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:07.933092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 143/281] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:07.937812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab86dc3-a7da-426c-9fe3-b4d7d7985bab None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-63505808-4cf9-4000-8de2-3e7e9d2143b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:07.938948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:07.939838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:07.940635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 139/282] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:07.941832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:07.941832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:07.942116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:07.965994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:07.968010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:07.977590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.052146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 140/283] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:08.053061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.081019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab86dc3-a7da-426c-9fe3-b4d7d7985bab None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.117733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.118273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.118550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.118871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.119595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, user.id=63831ee388ec4f22843d5ebb4621f000, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:08.119944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.121478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.127678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 144/284] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Aug 8 02:03:07 2022] GET /identity/v3/role_assignments?user.id=63831ee388ec4f22843d5ebb4621f000&scope.system=all&role.id=f2aede2952884054a38514133b316bb1 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.128659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.195627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623feb1-958f-4020-9c34-b946015a4eaa None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.217797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.268251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.272517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81fc-f5e5-4ee6-b5b2-b52d413267fe None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.275636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.276269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.276541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.276834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.277507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:08.277802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.279841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.300216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 141/285] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.306290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.315532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.316175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.316452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.316763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.330704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:08.337063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:08.338421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:08.339356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 145/286] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:08.345047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.427614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180254-3219-4c87-940d-b7ff9b10c377 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.455518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c414-e82b-4615-a298-20e056b3b768 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.462983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.463837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.464218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.464552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] PATH_INFO: `/v3/users/818c512cdc654606a02f3717dc07f633` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.465842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] RBAC: Authorizing `identity:get_user(user_id=818c512cdc654606a02f3717dc07f633)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.468043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.477255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 142/287] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/users/818c512cdc654606a02f3717dc07f633 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.482697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.492486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.493224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.493507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.493773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.494437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:08.494734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.496100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.505455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 146/288] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.510886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.537209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.565280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.619756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c4e2-7261-42b8-b549-64051d9f708f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.656688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.657670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.658020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.658366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] PATH_INFO: `/v3/users/1f419dae78b243379833a826e1acd3f2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.660105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] RBAC: Authorizing `identity:get_user(user_id=1f419dae78b243379833a826e1acd3f2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.661678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.663645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 147/289] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/users/1f419dae78b243379833a826e1acd3f2 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.669163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.670248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14aa4a-5444-41fb-a340-b41e20f16176 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.734815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.735463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.735813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.736158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.833829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:08.857314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99450c-3358-4b7f-b720-10ef4fa6cd34 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:08.860679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.862572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.901528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:08.902188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:08.902464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:08.902730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:08.904556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:08.906030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:08.908080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 148/290] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:08.913890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:08.935310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:09.022146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba308b0-3214-4938-8c98-39cfe14b552d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:09.046254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 143/291] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:03:09.051850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:09.063744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:09.064419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:09.065038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:09.065324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/1f419dae78b243379833a826e1acd3f2/roles/0fbc17a20e70477c94af817864ff0cd5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:09.067252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, user_id=1f419dae78b243379833a826e1acd3f2, role_id=0fbc17a20e70477c94af817864ff0cd5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:09.068849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:09.091895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 149/292] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:08 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/users/1f419dae78b243379833a826e1acd3f2/roles/0fbc17a20e70477c94af817864ff0cd5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:09.212257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270a68a-fa8f-4a49-a825-a2061d6fcaac None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:09.250889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:09.251590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:09.251873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:09.252147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:09.253300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:09.254788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7abb3-942c-4b34-acbb-4acba1e5cdeb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:09.256891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 144/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:09 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:09.265880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:09.288221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:09.380070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efe21-c46e-4d6c-99c6-d509e24ef8a9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:09.421576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:09.422190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:09.422470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:09.422740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:09.423468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=818c512cdc654606a02f3717dc07f633) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:09.423773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:09.429922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe7c76-aaec-4c54-9053-7bd4d864b4f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:09.436441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 150/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:09 2022] GET /identity/v3/role_assignments?user.id=818c512cdc654606a02f3717dc07f633&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=f2aede2952884054a38514133b316bb1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:10.140061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1250a4-78dc-4056-b023-68c4316a91fc None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.140585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1250a4-78dc-4056-b023-68c4316a91fc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.140585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1250a4-78dc-4056-b023-68c4316a91fc None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.142223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 145/295] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:10.148130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.148577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.149029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.172750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:10.174204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:10.230132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b8de-b180-43f0-af89-cc4611561f1a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.230406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b8de-b180-43f0-af89-cc4611561f1a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.230849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b8de-b180-43f0-af89-cc4611561f1a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.233049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 146/296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:10.239688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.240188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.240688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.256333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 151/297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:10.262800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:10.264391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:10.272501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.279459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.292483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.355034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 147/298] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:10.383552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.401352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8d8e-716e-4b3b-856d-edb1e21538fa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:10.439043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:10.439794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.440169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.440531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.453942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:10.459511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:10.460732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:10.461757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:10.464734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 152/299] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:10.469553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.515155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8c0a-2a24-4d7b-95a0-54ee0ae14dbd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:10.550099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.557423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:10.558313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.558828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.559315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.561264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:10.562896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:10.568767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 148/300] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:10.571631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.584762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c75de-e890-4cc0-abe9-c69d2a745515 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:10.587965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.628254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:10.628970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.629249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.629519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.630179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:10.630482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:10.631840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277215-e787-4ee3-9e70-acac122b8141 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:10.640923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 153/301] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:10.641910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac4c6-9184-4a66-9cc4-50c7564da33e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.642190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac4c6-9184-4a66-9cc4-50c7564da33e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.642460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac4c6-9184-4a66-9cc4-50c7564da33e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.643787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 154/302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:10.646443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac4c6-9184-4a66-9cc4-50c7564da33e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.688061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb783-eba4-4548-b5f2-fdafb990d4b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:10.724695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:10.725308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.725585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.725849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] PATH_INFO: `/v3/groups` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.726461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:10.727899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02285b-e01b-4794-b94b-34b11011caea None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:10.748300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 149/303] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Aug 8 02:03:10 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:10.749751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.750114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.750511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.766681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac4c6-9184-4a66-9cc4-50c7564da33e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:10.770965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:10.772196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:10.806589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:10.807682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:10.808279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:10.808889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] PATH_INFO: `/v3/users/3d19672f60e940389b811ecfd5b50eae` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:10.820200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.829300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] RBAC: Authorizing `identity:get_user(user_id=3d19672f60e940389b811ecfd5b50eae)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:10.831382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:10.833682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 155/304] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/users/3d19672f60e940389b811ecfd5b50eae => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:10.841799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.854319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:10.860885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 150/305] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:10.883760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:10.997323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed801a2-a242-40d8-9dbe-5972ea6d01dd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.005120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e55bd-e91d-4be3-ab08-84c15ccd659d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.043428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.044685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.045019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.045460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.046292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, user.id=3d19672f60e940389b811ecfd5b50eae, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:11.046696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:11.047379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.048133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:11.048483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.048955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.049399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.054517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 156/306] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/role_assignments?user.id=3d19672f60e940389b811ecfd5b50eae&scope.system=all&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:11.064092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:11.069098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:11.070052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:11.070864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 151/307] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:11.077231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:11.141339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:11.193232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7608f-2572-4345-ae6b-d396f46823c9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.231010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.231619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.232175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.232521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.233227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:11.233531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:11.234885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff34c70-acd8-4318-81c6-d1290ba01267 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:11.244716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 157/308] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:11.251144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:11.316342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:11.361749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd4d87-484c-4578-b001-0b93a88a9a94 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.398178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4091-d0ac-4ec9-93e7-9b9127bc7d90 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.398686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4091-d0ac-4ec9-93e7-9b9127bc7d90 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.398766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4091-d0ac-4ec9-93e7-9b9127bc7d90 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.400190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 158/309] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:11.405522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.405688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.405969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.406238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.406924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.407407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.407869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] PATH_INFO: `/v3/users/63831ee388ec4f22843d5ebb4621f000` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.409273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] RBAC: Authorizing `identity:get_user(user_id=63831ee388ec4f22843d5ebb4621f000)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:11.410908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:11.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 152/310] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:11 2022] GET /identity/v3/users/63831ee388ec4f22843d5ebb4621f000 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:11.421726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:11.434572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:11.436605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:11.528924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 159/311] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:11.533014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bfbda-44db-46ac-9854-bf14079eca58 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.549029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:11.560956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:11.571516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.572173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.572449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.572824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] PATH_INFO: `/v3/system/users/63831ee388ec4f22843d5ebb4621f000/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.574291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63831ee388ec4f22843d5ebb4621f000, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:11.576262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:11.588629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 153/312] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Aug 8 02:03:11 2022] PUT /identity/v3/system/users/63831ee388ec4f22843d5ebb4621f000/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:11.621229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:11.673433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35426-2fc4-4c62-9b8b-1ec321755953 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.712619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.713296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.713571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.713836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.726225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:11.731204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:11.732806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:11.733615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 160/313] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:11.741779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:11.861304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd93f-e268-4561-9995-2f38db37dc24 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:11.897588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:11.898201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:11.898473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:11.898743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:11.899399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:11.899700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:11.901126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:11.910119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 154/314] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:11.915922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:12.026930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f5e1-ab85-4313-919e-cbd4e742c95d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:12.034839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:12.063498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:12.064127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.064457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.064757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] PATH_INFO: `/v3/users/1f419dae78b243379833a826e1acd3f2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.065889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] RBAC: Authorizing `identity:get_user(user_id=1f419dae78b243379833a826e1acd3f2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:12.067423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:12.069424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 161/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:11 2022] GET /identity/v3/users/1f419dae78b243379833a826e1acd3f2 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:12.077752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:12.139907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:12.189512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841f0d-fd6f-4e4e-892d-cd224b6e0ed3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:12.224713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:12.225684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.226154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.226612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.299416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:12.301730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:12.357767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:12.407223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 155/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:12.413766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:12.526729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e01c23-c4e2-465f-a539-64d59c0bac80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:12.562354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a877868-6363-4a97-9599-beac781779bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:12.563010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877868-6363-4a97-9599-beac781779bb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.563296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877868-6363-4a97-9599-beac781779bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.563564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877868-6363-4a97-9599-beac781779bb None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.564690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a877868-6363-4a97-9599-beac781779bb None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:12.566233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a877868-6363-4a97-9599-beac781779bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:12.568135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 162/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:12 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:12.573998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:12.678684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8508-f0b3-472f-a84f-a98cb975c9c2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:12.715089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:12.715700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.716004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.716915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.717707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed, user.id=1f419dae78b243379833a826e1acd3f2) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:12.718017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:12.719516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4100-2bb8-482f-a4d7-aafcbed1fbdd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:12.727685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 156/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:12 2022] GET /identity/v3/role_assignments?user.id=1f419dae78b243379833a826e1acd3f2&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:12.947154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0b8e-fb02-470e-b600-c858ffc0fa62 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.947339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0b8e-fb02-470e-b600-c858ffc0fa62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.947601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0b8e-fb02-470e-b600-c858ffc0fa62 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.949196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 163/319] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:12.955379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efa22-18cd-4063-b54f-31e195f08c46 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:12.955659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efa22-18cd-4063-b54f-31e195f08c46 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:12.955930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efa22-18cd-4063-b54f-31e195f08c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:12.975377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d63efa22-18cd-4063-b54f-31e195f08c46 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:12.976767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d63efa22-18cd-4063-b54f-31e195f08c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:12.990613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:13.043289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:13.065928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0b8e-fb02-470e-b600-c858ffc0fa62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.112713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:13.172458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0b8e-fb02-470e-b600-c858ffc0fa62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:13.196696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfab30e-8185-4c07-94ec-895c5621bb83 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.196974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfab30e-8185-4c07-94ec-895c5621bb83 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.197300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfab30e-8185-4c07-94ec-895c5621bb83 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.198829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 158/321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:13.205073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.205431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.205781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.211465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:13.212100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.212380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.212667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.213780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:13.215196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:13.217614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 164/322] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:13.223397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.226272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:13.227468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:13.301040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:13.323578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.332104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970f1d-8f5b-4586-8902-dbc7b47bcfbc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:13.344041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:13.371605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:13.373304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.373874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.374342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] PATH_INFO: `/v3/groups` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.375156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:13.376588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:13.394969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 165/324] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Aug 8 02:03:13 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:03:13.421493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:13.445895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc1e3-0c6a-4e0c-8c73-d918954320a0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:13.487173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:13.487719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.487991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.488251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.501040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:13.505847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:13.506799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:13.513807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 160/325] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:13.515187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.628690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26384e-29d1-40f4-b65b-525c693b9e45 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:13.664197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:13.664842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.665124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.665400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.666075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:13.666382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:13.667821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4d012-0d03-4990-8ae0-24ec10864fb5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:13.677744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 166/326] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:13.683808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.732545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156331cf-77b0-4057-82c7-28330a1cdd15 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.732876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156331cf-77b0-4057-82c7-28330a1cdd15 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.733134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156331cf-77b0-4057-82c7-28330a1cdd15 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.734767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 167/327] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:13.740025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.740258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.740513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.764952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:13.766516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:13.796834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:13.806023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cadbf-fe47-428c-b731-fb3517cf63c2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:13.855074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 168/328] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:13.860107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:13.860107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:13.860107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:13.860107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] PATH_INFO: `/v3/users/3d19672f60e940389b811ecfd5b50eae` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:13.860440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] RBAC: Authorizing `identity:get_user(user_id=3d19672f60e940389b811ecfd5b50eae)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:13.861378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:13.862979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 161/329] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:13 2022] GET /identity/v3/users/3d19672f60e940389b811ecfd5b50eae => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:13.868580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.882570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:13.894299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:14.001696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e32f3-a8d5-476c-a69a-cf94469a994b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:14.019532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b959-bcee-4b85-9fce-26607e2b3674 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:14.042543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:14.043615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:14.044677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:14.045152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] PATH_INFO: `/v3/system/users/3d19672f60e940389b811ecfd5b50eae/roles/0fbc17a20e70477c94af817864ff0cd5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:14.046922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d19672f60e940389b811ecfd5b50eae, role_id=0fbc17a20e70477c94af817864ff0cd5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:14.048504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:14.065191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 169/330] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Aug 8 02:03:13 2022] PUT /identity/v3/system/users/3d19672f60e940389b811ecfd5b50eae/roles/0fbc17a20e70477c94af817864ff0cd5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:14.069312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:14.070293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:14.070293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:14.070589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:14.087493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:14.093515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:14.094489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:14.095310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:14.100205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 162/331] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:14.101690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:14.139391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:14.230483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7686e-c5a6-44a8-94fd-4caa1d9359ef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:14.269242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:14.270205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:14.270687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:14.271128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:14.272001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:14.272474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:14.274049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:14.288758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 170/332] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:14.291422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:14.369222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:14.408163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78cd15-67da-4c4b-8f21-52bec3c3e179 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:14.443838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:14.444465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:14.444763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:14.445033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] PATH_INFO: `/v3/users/63831ee388ec4f22843d5ebb4621f000` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:14.446159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] RBAC: Authorizing `identity:get_user(user_id=63831ee388ec4f22843d5ebb4621f000)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:14.447648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51136555-d332-4dbc-bc01-8fa144814519 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:14.453471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 163/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:14 2022] GET /identity/v3/users/63831ee388ec4f22843d5ebb4621f000 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:14.455667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:14.551746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:14.567328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd5c8-4fe1-4276-96d6-cd94074444e1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:14.605554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:14.606167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:14.606445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:14.607307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:14.608211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] RBAC: Adding query filter params (role.id=f2aede2952884054a38514133b316bb1, user.id=63831ee388ec4f22843d5ebb4621f000, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:14.608518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:14.609967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b511ef9-61ca-47b9-8088-eec052130e28 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:14.627290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 171/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Aug 8 02:03:14 2022] GET /identity/v3/role_assignments?user.id=63831ee388ec4f22843d5ebb4621f000&scope.system=all&role.id=f2aede2952884054a38514133b316bb1 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:15.972862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c129-f5ca-4a9a-8893-c363b78bfc55 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:15.973371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c129-f5ca-4a9a-8893-c363b78bfc55 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:15.973371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c129-f5ca-4a9a-8893-c363b78bfc55 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:15.975295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 164/335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:15.980804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:15.981212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:15.981379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.002862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:16.004048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:16.084323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 172/336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:16.128445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8c129-f5ca-4a9a-8893-c363b78bfc55 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:16.260619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8c129-f5ca-4a9a-8893-c363b78bfc55 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:16.301823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:16.302520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.302797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.303063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.305276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:16.318963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:16.323691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:16.324579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:16.326187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:16.328568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 165/337] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:16.333644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:16.423735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:16.456768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716dcca-a75e-48a1-a3f4-590a09d02841 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:16.501348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:16.501951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.502227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.502497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.503199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:16.503498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:16.504875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d79e35-37d8-426e-a0bf-8d1d6250725e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:16.518939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 173/338] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:16.524167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:16.614525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411ea-565d-43bd-ba05-6022917e9269 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.614879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411ea-565d-43bd-ba05-6022917e9269 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.615064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411ea-565d-43bd-ba05-6022917e9269 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.616396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 174/339] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:16.621702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40866b-f4aa-4852-b21d-d538dba5f16f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.621983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40866b-f4aa-4852-b21d-d538dba5f16f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.622790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40866b-f4aa-4852-b21d-d538dba5f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.660947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2e40866b-f4aa-4852-b21d-d538dba5f16f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:16.662160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e40866b-f4aa-4852-b21d-d538dba5f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:16.665730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f408f-60ea-4de6-b30f-61431f66de2a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:16.714702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:16.715316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.715590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.716502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.806342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:16.807073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 175/340] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:16.810591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9198b-a9a8-4eae-854a-33d0341a2d44 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.810907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9198b-a9a8-4eae-854a-33d0341a2d44 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.811206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9198b-a9a8-4eae-854a-33d0341a2d44 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.815125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 176/341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:16.821463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:16.821794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:16.822062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:16.827459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:16.828995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92e41-75c6-42b0-b367-281ed2211723 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:16.862433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:16.863640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:16.987727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:16.994462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 177/342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:16.995311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.011446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 166/343] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:17.013402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5adc-811a-4b10-949e-a613f7f25cb6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.013810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5adc-811a-4b10-949e-a613f7f25cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.014288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5adc-811a-4b10-949e-a613f7f25cb6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.015768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 167/344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:17.025843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc5adc-811a-4b10-949e-a613f7f25cb6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.124959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2cbbd-d393-4855-a495-b81f33632842 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.164062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.176039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.176495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc5adc-811a-4b10-949e-a613f7f25cb6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.177245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.177712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.178352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.197321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a7f524e9-d5d8-474b-85e8-7f493731fbb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:17.204404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:17.205301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:17.206099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:17.208664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 178/345] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:17.210769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.211192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.211866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.223489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.223705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.224061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.224740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.226473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.228204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.230529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 168/346] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:17.231839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.237401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:17.238822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:17.304395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.321801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 179/347] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:17.322791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.353214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b47a9-2a66-4757-9f92-26ba595637e2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.392172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.393145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.393601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.394037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.405408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:17.411182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:17.412069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:17.412990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:17.419085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 169/348] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:17.420466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.445623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa97c-0e66-460f-b086-c67978b91ad5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.449894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.482600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.483186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.483462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.483729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.484455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:17.484785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.486221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.495231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 180/349] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:17.496316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.538765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd64a0-1e0a-49bb-be91-fb6090741c52 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.550734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.578931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.579944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.580576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.581058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.587902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.589846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.593592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 170/350] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:17.594686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.606226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310311-f208-4f94-878e-9a485d4f2b54 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.644429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.645321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.645735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.646138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.657504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:17.663355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:17.664262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:03:17.665192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:17.667649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 181/351] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:17.668595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.692068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.709796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9fa9-3875-4c54-a9a0-d93f3a42371e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.749260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.749873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.750147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.750418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.751084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:17.751383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.752790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.762125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 171/352] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:17.763636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.783972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dc105-7b35-4c09-bf92-7a8860d22654 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.796250 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:17.826334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.826944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.827216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.827477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.891910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18eab-8e44-4ecc-b4f7-8f711a49c181 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:17.926117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.928190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.935243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:17.935860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:17.936136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:17.936406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:17.937177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=f2aede2952884054a38514133b316bb1, scope.project.id=6264bfc23acf4a2d969b177df67b7239) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:17.937481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:17.938921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:17.946717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 172/353] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=f2aede2952884054a38514133b316bb1 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:17.947616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:17.966852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.107285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 182/354] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:18.109160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.113305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0035-b793-42a1-854d-5f96bc28f72e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.135453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.173335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.174536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.175060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.175337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.176007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:18.176362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.177888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.189062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 173/355] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.190193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.277329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715617e-cb9d-4c4a-9437-6fb3d8090acc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.291860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.325433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe17c-ccbc-41b4-8e81-943427821678 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.325674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.326182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.326458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.326730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.372679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.373475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.373755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.374025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.375185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.377137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affea3de-cb09-4048-bd87-f6133fef8937 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.379320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 174/356] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.383982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1878-e8bd-4c4f-a060-f9424f1dcd3e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.383982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1878-e8bd-4c4f-a060-f9424f1dcd3e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.383982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae1878-e8bd-4c4f-a060-f9424f1dcd3e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.383982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 175/357] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:18.383982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae1878-e8bd-4c4f-a060-f9424f1dcd3e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.423827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.428027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adea71-37af-4fbc-be03-d1eee2350e5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.443234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.531203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae1878-e8bd-4c4f-a060-f9424f1dcd3e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.566543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 183/358] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:18.568139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db37b5-1b80-4a45-97af-4ba6b6f2a7b5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.568698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db37b5-1b80-4a45-97af-4ba6b6f2a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.569205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db37b5-1b80-4a45-97af-4ba6b6f2a7b5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.570726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 184/359] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:18.571630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db37b5-1b80-4a45-97af-4ba6b6f2a7b5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.572052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.572719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.573044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.573255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] PATH_INFO: `/v3/users/3d19672f60e940389b811ecfd5b50eae` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.574378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] RBAC: Authorizing `identity:get_user(user_id=3d19672f60e940389b811ecfd5b50eae)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.578486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56dd1-8c85-453d-81a9-371deb75a789 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.580662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 176/360] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/users/3d19672f60e940389b811ecfd5b50eae => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.581898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881fc64-3f9b-4a94-bc62-2eb796cd6400 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.582172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881fc64-3f9b-4a94-bc62-2eb796cd6400 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.582436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881fc64-3f9b-4a94-bc62-2eb796cd6400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.604823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2881fc64-3f9b-4a94-bc62-2eb796cd6400 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:18.606017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2881fc64-3f9b-4a94-bc62-2eb796cd6400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:18.609379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.683381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 177/361] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:18.685405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.685684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.685949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.703964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:18.705181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:18.709379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db37b5-1b80-4a45-97af-4ba6b6f2a7b5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.724674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.757205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.757858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.758136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.758410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.759866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.761724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.764316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 185/362] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.764924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.794407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 178/363] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:18.795573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.878097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:18.901081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30227f07-1b22-4cc4-be6e-eeba91c8edc0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.917657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a383e4-3fa4-4518-95c9-220dd72964a5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:18.948227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.949220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.949643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.950029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.951555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.953685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.955371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 186/364] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.956133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:18.957842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:18.958636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:18.959060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:18.959764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:18.961638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] RBAC: Adding query filter params (role.id=0fbc17a20e70477c94af817864ff0cd5, user.id=3d19672f60e940389b811ecfd5b50eae, scope.system=all) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:18.962106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:18.963719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:18.983565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 179/365] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/role_assignments?user.id=3d19672f60e940389b811ecfd5b50eae&scope.system=all&role.id=0fbc17a20e70477c94af817864ff0cd5 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:18.985107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.012481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.094771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f458c-20cd-4272-9027-4ba8528f8169 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.127404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b385-000f-45ac-80ab-48b8f5311590 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.137272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.139252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.139678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.140094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.154600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:19.161642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:19.162589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:19.163433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:19.164062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.166671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 187/366] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:19.167961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.175286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.175907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.176180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.176445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.177215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=6264bfc23acf4a2d969b177df67b7239) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:19.177521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.179246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:19.187192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 180/367] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:18 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=a865e4a5849e49a0803176776de27f92 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:19.188100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.319329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c9582-14ba-46c6-acb9-baed4030b57d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.327112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988cee-8586-45e8-bfb8-8abebf25f46e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.331692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.368888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.369527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.369804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.370074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.370189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.370773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.371061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.371351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.373310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.374919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:19.376583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 181/368] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:19.377415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.384058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:19.390400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:19.391341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:19.392146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:19.392829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 188/369] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:19.393383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.470636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.533096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c84b41-2f6a-4b20-881c-65576effda9d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.552305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c989fa4-e6eb-4657-86a9-e0af84d7d64f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.570519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.571045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.571321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.571591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.572311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=f2aede2952884054a38514133b316bb1, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:19.572620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.574082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:19.580158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 189/370] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=f2aede2952884054a38514133b316bb1 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:19.581005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.601877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.602509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.602899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.603190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.603859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:19.604162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.605696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:19.617602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 182/371] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:19.623970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.633606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.773464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61cb0f-8b22-43dc-9743-ddd298fd5162 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.807358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.807977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.808259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.808533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.809270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:19.810310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.811820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:19.817915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d83c-f6c3-4808-8cf6-fd20179621f5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:19.828494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 190/372] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:19.834298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:19.847825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:19.858976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:19.859982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:19.860494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:19.860995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:19.946257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:19.948072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.040629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.050808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43768c92-7eda-4c0a-9e22-2ea347b6ceb1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.097814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.098375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.098873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.098997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.104001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 183/373] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:20.110048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.142041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.194235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.195714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.242395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38c86-56cf-4e18-9701-7615c4ae6e1e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.284152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.284841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.285121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.285393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.286530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.288444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.289928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 184/374] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:20.295236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.316018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.332671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 191/375] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:03:20.335745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.415479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.430037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81c4f-f9d6-47af-81ef-96b6898c7aa5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.448121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec9230-f989-4f13-a21e-e18035f20825 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.487204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.487846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.488127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.488400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.490357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.490986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.491258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.491595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] PATH_INFO: `/v3/projects/b5a665df524c40cebad50de6721ccb89` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.492405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.493885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.495646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 185/376] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:20.496129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] RBAC: Authorizing `identity:get_project(project_id=b5a665df524c40cebad50de6721ccb89)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.498291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.499918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 192/377] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/projects/b5a665df524c40cebad50de6721ccb89 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:20.505217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.506579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.589561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.638978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128d17e-f74d-42bb-a80d-c1368c8cddcb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.640036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befc99a-6ac6-4188-903d-c6b5993a8926 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.678065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.679023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.679503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.679968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.680955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:20.681461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.683279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5712-2d25-4a3a-8c3f-c0481f533333 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.687482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.687980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.688261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.688534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] PATH_INFO: `/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.691649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 186/378] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=a865e4a5849e49a0803176776de27f92 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:20.693202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d19-f7a6-476e-819d-6741813895e8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.693725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d19-f7a6-476e-819d-6741813895e8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.694193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d19-f7a6-476e-819d-6741813895e8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.695958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 187/379] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:20.701900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.702493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.702964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.708921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] RBAC: Authorizing `identity:get_group(group_id=a4a922cae0dc45408dcf3b9b7f63056c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.710399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.712461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 193/380] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:20.721724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.725113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:20.726553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:20.747776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.820767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 188/381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:20.847769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:20.917636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6946-add2-4411-bae1-8d5b4ebf2903 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.949410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:20.960485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:20.961175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:20.961448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:20.961714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:20.962432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] RBAC: Adding query filter params (group.id=a4a922cae0dc45408dcf3b9b7f63056c, role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=b5a665df524c40cebad50de6721ccb89) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:20.963405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:20.964572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:20.966340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921120-2cb2-45d5-a783-39722c33dab3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:20.975520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 194/382] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/role_assignments?group.id=a4a922cae0dc45408dcf3b9b7f63056c&scope.project.id=b5a665df524c40cebad50de6721ccb89&role.id=c263d8337db14b7e938c9a63cd631fad => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:21.006670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:21.007855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:21.008345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:21.008861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:21.022434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:21.027904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:21.029431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:21.030329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:21.033135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 189/383] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:21.039436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:21.180255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f538e4-35ba-498b-a8d7-bd2fce5c066f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:21.223681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:21.225314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:21.225895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:21.226378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:21.227252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:21.227747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:21.229348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:21.243887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 195/384] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:21.250305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:21.267540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:21.360717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352797d-c356-4130-8320-f60cb6ffb9de None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:21.398278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:21.398919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:21.399198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:21.399471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:21.400584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:21.402076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:21.404598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 190/385] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:21 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:21.410127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:21.463167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:21.520411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b6bb-c593-409d-8d9f-6b3daa4dc19f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:21.557979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:21.558613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:21.558890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:21.559162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:21.561081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:21.562505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048aaec-d277-4dca-9183-2bf888685979 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:21.564531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 196/386] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:21 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:21.570479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:21.685373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df55363-3d1b-4b40-a130-ec7a8fcb76e9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:21.691926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:21.725048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:21.725774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:21.726052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:21.726323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:21.728325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, group_id=5ebf047d4e3b410d9879c8b4ac2532c0, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:21.732242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb77b-681f-4695-826b-0377c5503eca None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:21.750531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 191/387] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Aug 8 02:03:21 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:22.193224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21a35-b288-47c1-a294-7bf4a4dc568d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.193715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21a35-b288-47c1-a294-7bf4a4dc568d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.194097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21a35-b288-47c1-a294-7bf4a4dc568d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.195820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 197/388] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:22.201022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.201314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.201592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.221909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:22.223099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:22.296470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 192/389] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:22.319887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d21a35-b288-47c1-a294-7bf4a4dc568d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:22.443068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d21a35-b288-47c1-a294-7bf4a4dc568d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:22.466984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:22.489447 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:22.490085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.490363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.490715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.509962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-44661259-117b-49fe-8c24-dfe33ab7e089 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:22.514845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:22.515785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:22.516629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 198/390] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:22.522121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:22.606044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:22.640578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42577-abde-4d27-bb0b-aa2a954b8ee8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:22.676874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:22.677494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.677771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.678043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.678710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:22.679011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:22.680385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:22.684593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423d7cf-038e-4498-a1b1-0db8fa13a663 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.684917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423d7cf-038e-4498-a1b1-0db8fa13a663 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.685162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423d7cf-038e-4498-a1b1-0db8fa13a663 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.686836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 199/391] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:22.693702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 193/392] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:22.698065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.698350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.698624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.709243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:22.725517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:22.727102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:22.847566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2111667-e616-48e6-8150-d198a5a8f1d9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:22.868470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 200/393] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:22.881631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:22.895169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:22.896223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:22.896744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:22.897220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:22.901347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:22.903049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:22.905531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 194/394] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:22 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:22.908415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:22.911564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.069896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf36d3-f472-448b-be07-2ac339885302 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.113363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.114845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.115529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.116003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.117356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.118994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.121370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 195/395] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:22 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:23.128953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.165833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73094-042a-4790-9d34-ebfabd6c463c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.180567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.213977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.214877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.215159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.215436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.220844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.230513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f1e29845-ac18-4817-b6ee-ad37a90165e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:23.235777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:23.236696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:23.237495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:23.239742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 201/396] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:23.245673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab1d2-36e9-475e-a0c3-eb14080af25a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.246175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab1d2-36e9-475e-a0c3-eb14080af25a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.246652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab1d2-36e9-475e-a0c3-eb14080af25a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.249219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 202/397] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:23.254260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.254762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.255228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.267645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f89a-aad0-4b05-9717-4d0ac98bd90c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.274174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:23.275598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:23.311491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.312162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.312443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.312741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.315840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=6264bfc23acf4a2d969b177df67b7239, group_id=5ebf047d4e3b410d9879c8b4ac2532c0, role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.317336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.335895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 196/398] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Aug 8 02:03:23 2022] PUT /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/a865e4a5849e49a0803176776de27f92 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:23.336930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.359817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 203/399] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:23.382929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.462384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a0a-c1e6-47a8-a108-978bfffa6a5e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.492805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.498454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.504058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd254c2-05bc-4d3d-b0e8-eea5747e324b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.506271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.508042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.508582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.509077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.510001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:23.510510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.512130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.526953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 197/400] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:23.528589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.546545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.547066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.547348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.547616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.559097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:23.564875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:23.565833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:23.567081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 204/401] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:23.572204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.646958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4878-de30-47cf-95be-5bb8ce5ee46f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.682795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.683233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec927c7-6369-43f4-9d77-9c80b0f717a2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.684064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.685247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.685730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.687107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.688873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.690649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 198/402] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:23.696289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.721415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.722088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.722373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.722647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.723315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:23.723628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.725316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.734978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 205/403] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:23.740362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.762533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.765054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:23.818752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae740af-f038-4302-8acb-dea80050a99d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.849986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8611a-0e5c-4cdd-b416-026a98dddbe5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:23.867983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.868624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.868934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.869210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.870851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.872720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e67ea8-974e-4817-a656-26de87457061 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.875471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 199/404] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:23.876719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c30d-247f-4f2c-8e78-58b5a4c2f584 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.877002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c30d-247f-4f2c-8e78-58b5a4c2f584 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.877276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c30d-247f-4f2c-8e78-58b5a4c2f584 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.878695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 200/405] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:23.883539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964c30d-247f-4f2c-8e78-58b5a4c2f584 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:23.891995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:23.892637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.892941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.893279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.894425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:23.895863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e80fc-a6e8-4501-921c-ae8803a00229 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:23.897818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 206/406] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:23.898898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:23.899180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:23.899452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:23.922492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:23.923830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:23.996243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 207/407] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:23.998327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.007669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964c30d-247f-4f2c-8e78-58b5a4c2f584 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.028916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.039605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.057417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.058094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.058430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.058705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.061827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, group_id=5ebf047d4e3b410d9879c8b4ac2532c0, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.063761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.082872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 201/408] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Aug 8 02:03:23 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:24.083801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.140548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260dcc9-1160-4ef6-ac98-d033e32f546e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.179423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.180077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.180420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.180804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.182067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.183745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.186739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 208/409] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:23 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:24.192382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.201785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515a0c-9de1-4ac3-991e-8e02370b63d0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.240677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.241397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.241677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.241949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.255088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:24.260569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:24.261522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:24.262306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 202/410] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:24.269504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.345051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.361285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.366211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1cf04-42eb-4687-ba36-0c5f2731ca04 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.421889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.422566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.422843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.423111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.428626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b3f8-2010-4883-8012-a981f8a98e21 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.430603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1cda92dba74da2bdc746f1412b94ed, group_id=5ebf047d4e3b410d9879c8b4ac2532c0, role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.432002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.452840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 209/411] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Aug 8 02:03:24 2022] PUT /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed/groups/5ebf047d4e3b410d9879c8b4ac2532c0/roles/a865e4a5849e49a0803176776de27f92 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:03:24.471716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.472332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.472610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.472971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.473644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:24.473944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.475584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.486427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 203/412] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:24.493005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.609577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011cfe-fb58-4919-8ec3-302ad98d3576 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.648522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.649200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.649478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.649749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] PATH_INFO: `/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.650901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] RBAC: Authorizing `identity:get_group(group_id=a4a922cae0dc45408dcf3b9b7f63056c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.652381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb054a9-ef30-40f4-810b-3a39ca395e01 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.654473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 210/413] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:24 2022] GET /identity/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:24.659785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.692721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3ad7-f3b3-46d1-a9b3-c70bea5778cc None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.693026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3ad7-f3b3-46d1-a9b3-c70bea5778cc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.693265 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3ad7-f3b3-46d1-a9b3-c70bea5778cc None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.694933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 211/414] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:24.702016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.702287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.702562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.724598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:24.726403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:24.740439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.814917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 212/415] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:24.840214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:24.842118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491467-3f2e-4447-9581-5f140377b765 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:24.863907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:24.915099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:24.916241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:24.916737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:24.917217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] PATH_INFO: `/v3/projects/b5a665df524c40cebad50de6721ccb89` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:24.921549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] RBAC: Authorizing `identity:get_project(project_id=b5a665df524c40cebad50de6721ccb89)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:24.923227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:24.925109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 204/416] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:24 2022] GET /identity/v3/projects/b5a665df524c40cebad50de6721ccb89 => generated 344 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:24.930625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:25.080756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffdf2-f0e9-4c7f-af43-f03afe606a50 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:25.090207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4625fc4-39e8-4d64-aede-7d03082d47ef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:25.119838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:25.120814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:25.121099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:25.121377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] PATH_INFO: `/v3/projects/b5a665df524c40cebad50de6721ccb89/groups/a4a922cae0dc45408dcf3b9b7f63056c/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:25.124123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5a665df524c40cebad50de6721ccb89, group_id=a4a922cae0dc45408dcf3b9b7f63056c, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:25.125779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:25.145694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 205/417] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Aug 8 02:03:24 2022] PUT /identity/v3/projects/b5a665df524c40cebad50de6721ccb89/groups/a4a922cae0dc45408dcf3b9b7f63056c/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:03:25.161896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:25.162527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:25.162808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:25.163079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:25.174783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:25.179842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:25.180849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:25.182141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 213/418] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:25.188372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:25.239456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:25.328555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd890-01fc-4621-8698-2d2ff7a9dee3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:25.367061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:25.367666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:25.367875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:25.368125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:25.368826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:25.369132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:25.370516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:25.380266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 206/419] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:25.385624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:25.390001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:25.495373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf9e47-3c13-41cb-a8c9-0a7dcc62013e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:25.533251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:25.534275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:25.534547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:25.534815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:25.606923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:25.608570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:25.611355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:25.711313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 214/420] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:03:25.717489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:25.848960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406da63-7c87-4338-abc2-09d8cecee049 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:25.853060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:25.887289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:25.888472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:25.888908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:25.889098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:25.890212 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:25.891725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9506-3361-47b2-9dd6-2a39a479848d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:25.893763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 207/421] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:25 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:25.901722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.025854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b28e-44b1-4d3e-bce0-c1ce77056bb7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.031576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:26.044823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a491-e578-4bed-b7b7-e86b9c228a84 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.045107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a491-e578-4bed-b7b7-e86b9c228a84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.045384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a491-e578-4bed-b7b7-e86b9c228a84 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.046981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 208/422] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:26.057932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.058216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.058494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.072471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.073152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.073431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.073702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.075439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:26.076900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:26.078767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 215/423] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:25 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:26.084746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.099597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:26.100899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:26.206845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe37a7-d120-410b-ab02-5d10f3fe1c94 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.238357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 209/424] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:26.257412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.258026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.258306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.258571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.259306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=f2aede2952884054a38514133b316bb1, scope.project.id=6264bfc23acf4a2d969b177df67b7239) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:26.259613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:26.261197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:26.272052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 216/425] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:26 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=f2aede2952884054a38514133b316bb1 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:26.285047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.445010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:26.448110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff78e1f-93cc-4c87-87d4-418ac318eea5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.502216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.502866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.503143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.503410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.518240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1aa86ca7-7a94-4227-87d6-88d33457f759 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:26.523047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:26.523933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:26.525147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 210/426] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:26.530422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.569167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:26.627631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4bc2-3698-403b-ba92-2c1d02ecefc5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.627939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4bc2-3698-403b-ba92-2c1d02ecefc5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.628175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4bc2-3698-403b-ba92-2c1d02ecefc5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.629588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 211/427] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:26.635376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.635651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.635919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.657686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:26.658364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fd1b-8c33-4130-8711-2145c084a597 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.658877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:26.708281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.709079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.709461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.709828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.710598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:26.711001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:26.712479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:26.722035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 217/428] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:26.729380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.770092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 212/429] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:26.796208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:26.873222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:26.878263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195947a-5a1f-48e5-950c-dc9484240691 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.915066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:26.935594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace099cd-9bbc-4057-9100-e09c0fb19234 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:26.939092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.939977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.940456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.940957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.981189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:26.982304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:26.982784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:26.983252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:26.994910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:27.001103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:27.002003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:03:27.002832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:27.005247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 213/430] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:27.013702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.022585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.024491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687f14a-ec05-4bc4-88a3-e647e6f332fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.138848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d627b76-5bf4-4fad-ab8b-3a8074bece91 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.145140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.155559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 218/431] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:03:27.157164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4b31-aeec-458e-bf24-c540d8561500 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.157450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4b31-aeec-458e-bf24-c540d8561500 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.157723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4b31-aeec-458e-bf24-c540d8561500 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.160695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 219/432] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:27.160695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4b31-aeec-458e-bf24-c540d8561500 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.182046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.182651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.182924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.183191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.183844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:27.184140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.186672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149f579-a25d-48c1-8a82-eb3f4443fc49 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.196137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 214/433] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.197311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.197593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.197862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.217140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:27.218313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:27.220401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.277033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4b31-aeec-458e-bf24-c540d8561500 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.295437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 215/434] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:27.296291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.319432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.320116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.320400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.320693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] PATH_INFO: `/v3/projects/6264bfc23acf4a2d969b177df67b7239` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.321891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] RBAC: Authorizing `identity:get_project(project_id=6264bfc23acf4a2d969b177df67b7239)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.323388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.325925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 220/435] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/projects/6264bfc23acf4a2d969b177df67b7239 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.326678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.397682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.431654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4f31-5f1a-452a-82b6-5ee645b2544d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.440146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fe794-8e83-4c46-acb2-83e440797b38 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.469442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.470059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.470337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.470891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.479219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.480080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.482077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.482361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.482629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.493913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:27.499278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:27.500208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 221/436] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:27.501352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.548992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.550445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.610617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6650d-1208-400e-aaa0-af144dd9409d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.637986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.649515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.650655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.651300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.652105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.653836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.656188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.657976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 222/437] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.658693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 216/438] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:27.659113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.667899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.712235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.770473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5786f5-ce4f-460b-a7b6-1f9a434eab72 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.774358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725848-9c3e-4ab6-baa5-018b54b950c0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.804949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.805744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.806022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.806314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.806972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:27.807276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.807852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.808451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.808633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.808757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.809012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.809764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=6264bfc23acf4a2d969b177df67b7239) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:27.810068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.811473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56e8e-0d39-4dec-b606-885546bbbd29 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.816545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 223/439] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.828714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 217/440] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=6264bfc23acf4a2d969b177df67b7239&role.id=a865e4a5849e49a0803176776de27f92 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.828962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.829053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c761-defd-46ec-bda0-b21169faf66c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.829053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c761-defd-46ec-bda0-b21169faf66c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.829053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c761-defd-46ec-bda0-b21169faf66c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.829053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 218/441] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:27.829053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c761-defd-46ec-bda0-b21169faf66c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:27.894474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.942219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c761-defd-46ec-bda0-b21169faf66c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.943941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:27.944898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0cb8-4591-45af-9d54-e7278b14c412 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:27.983535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.984170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.984454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.984830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.985955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:27.987385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997c16a-4886-4fa2-a928-4f108b406736 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:27.988298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:27.989006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.989289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.989465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 224/442] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:27.989621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:27.990502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:27.990780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:27.991052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.016767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:28.018424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:28.073811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.075956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.094042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 225/443] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:28.094892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.164396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.198694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 219/444] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:28.199658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.202367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.216358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49a4b-a1da-4113-808a-898990c46d6f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.252007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.252622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.252923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.253187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.254273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.255683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.257251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 226/445] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:28.257990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.301348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7624-11c7-4119-9709-3d5d27ccc739 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.335431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.336053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.336330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.336597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.346573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:28.351539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:28.352449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:28.353293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 220/446] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:28.353966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.361869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4b7cc-0678-44af-8757-21f8fecf5c4e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.385129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.397006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.397630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.397903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.398169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] PATH_INFO: `/v3/projects/ef1cda92dba74da2bdc746f1412b94ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.399271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1cda92dba74da2bdc746f1412b94ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.400721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.402336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 227/447] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/projects/ef1cda92dba74da2bdc746f1412b94ed => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:28.403116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.421817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.461397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b446c-e172-4497-a231-2b2092513f39 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.495905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.496523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.496812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.497083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.497794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=f2aede2952884054a38514133b316bb1, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:28.498100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.499531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.516688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90149-a611-4a88-a54f-f333f0f23654 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.516913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 221/448] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=f2aede2952884054a38514133b316bb1 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:28.516913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.544716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.545845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.546139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.546687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.547384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:28.547949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.550092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.568011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 228/449] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:28.569836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.631827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6e20-aa3e-4fa5-9ccd-c75a895473f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.633140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.662858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.672389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.673159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.673437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.674195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] PATH_INFO: `/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.674850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=5ebf047d4e3b410d9879c8b4ac2532c0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.676292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.679000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 222/450] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/groups/5ebf047d4e3b410d9879c8b4ac2532c0 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:28.685496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.693143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e8d9-fb53-4751-9e3b-ba68e0134cef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.741142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.741685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.741991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.742260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.797241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5fc85-c684-46f4-b2ff-b8994901a6c0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:28.817693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.819227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.840848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:28.841835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:28.843755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:28.843755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:28.843755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] RBAC: Adding query filter params (group.id=5ebf047d4e3b410d9879c8b4ac2532c0, role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=ef1cda92dba74da2bdc746f1412b94ed) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:28.843755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:28.844960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:28.851284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 223/451] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/role_assignments?group.id=5ebf047d4e3b410d9879c8b4ac2532c0&scope.project.id=ef1cda92dba74da2bdc746f1412b94ed&role.id=a865e4a5849e49a0803176776de27f92 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:28.875867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:28.930335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 229/452] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:28.936346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:28.999243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:29.043009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4552e-00f6-4813-9d80-3c30997e7ed7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:29.076766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:29.077397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:29.077671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:29.077937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] PATH_INFO: `/v3/projects/b5a665df524c40cebad50de6721ccb89` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:29.079066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] RBAC: Authorizing `identity:get_project(project_id=b5a665df524c40cebad50de6721ccb89)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:29.080493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:29.082554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 224/453] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:03:28 2022] GET /identity/v3/projects/b5a665df524c40cebad50de6721ccb89 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:29.088319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:29.191160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d331dc-5a26-4a8b-bc70-d4b4151e35c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:29.227137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:29.227761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:29.228038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:29.228310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] PATH_INFO: `/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:29.229442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] RBAC: Authorizing `identity:get_group(group_id=a4a922cae0dc45408dcf3b9b7f63056c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:29.230880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a848b8-c70f-4f93-adec-8af7d3436275 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:29.233089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 230/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Aug 8 02:03:29 2022] GET /identity/v3/groups/a4a922cae0dc45408dcf3b9b7f63056c => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:29.239033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:29.335491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e481-e2e5-44d6-870d-08a8514a6d45 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:29.360659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:29.369282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:29.369876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:29.370157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:29.370430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:29.371143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] RBAC: Adding query filter params (group.id=a4a922cae0dc45408dcf3b9b7f63056c, role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=b5a665df524c40cebad50de6721ccb89) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:29.371446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:29.372948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b767f-0b37-4e85-b209-a9147e4cc3a2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:29.378485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 225/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Aug 8 02:03:29 2022] GET /identity/v3/role_assignments?group.id=a4a922cae0dc45408dcf3b9b7f63056c&scope.project.id=b5a665df524c40cebad50de6721ccb89&role.id=c263d8337db14b7e938c9a63cd631fad => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:31.968081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a78-794f-4e1d-b584-c7466b7aba5f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:31.968601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a78-794f-4e1d-b584-c7466b7aba5f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:31.968601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a78-794f-4e1d-b584-c7466b7aba5f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:31.970249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 231/456] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:31.975488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9cde-bd5a-4f28-b405-438b567babc6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:31.976321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9cde-bd5a-4f28-b405-438b567babc6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:31.976847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9cde-bd5a-4f28-b405-438b567babc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.005619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4dca9cde-bd5a-4f28-b405-438b567babc6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:32.007163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4dca9cde-bd5a-4f28-b405-438b567babc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:32.046104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f56c2-f74d-4806-96d6-61fce55cf4ee None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.046711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f56c2-f74d-4806-96d6-61fce55cf4ee None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.047279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f56c2-f74d-4806-96d6-61fce55cf4ee None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.049092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 232/457] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:32.054080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.054361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.054636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.077257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:32.078953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:32.100839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.132721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 226/458] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:32.134183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1294-acc6-4d89-a2d7-84f34d2f6bd1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.134559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1294-acc6-4d89-a2d7-84f34d2f6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.134955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1294-acc6-4d89-a2d7-84f34d2f6bd1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.136457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 227/459] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:32.142429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.142830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.143228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.171971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 233/460] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:32.173159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.181728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:32.182984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:32.274119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 228/461] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:32.280810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.311553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505a29-2baa-490a-910a-8f3a76df1747 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.334640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.358161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.359242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.359720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.360885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.375556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.377314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:32.394094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:32.395058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:32.395921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:32.395921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.395921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:32.395921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 234/462] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:32.396136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.399380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.402667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8357ba-4f93-4905-9284-33d2ce1fb116 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.456288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.457561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.458085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.459034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.474675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.477370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:32.494520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:32.495512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:32.501461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:32.501461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.501461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:32.501461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 229/463] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:32.501461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.530193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd684a2-968b-4e1a-bfd4-d80c8bd9cfdf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.564594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.565237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.565517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.565792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.576338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.577938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6b40c917-34b4-4b49-a396-0e1697625b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:32.594232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:32.595172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:32.596033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:32.596033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:32.596033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:32.596033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 235/464] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:32.596805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827991-3233-4c3e-b2e4-f99d197cf4f9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.596905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827991-3233-4c3e-b2e4-f99d197cf4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.597118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827991-3233-4c3e-b2e4-f99d197cf4f9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.600762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 236/465] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:32.600762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5827991-3233-4c3e-b2e4-f99d197cf4f9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.614195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e53ce-9fd2-4f9b-b12a-09d78c482c1d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.615886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.654826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.655700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.655981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.656256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.656931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:32.657235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.658652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.663597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.676759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 230/466] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:32.677604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.719373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5827991-3233-4c3e-b2e4-f99d197cf4f9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.757041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.757596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.757872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.758142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.758815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:32.759307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.760496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b472d5-ad48-47ac-b16b-0c67d108522d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.773381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 237/467] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:32.774463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.774749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.775020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.789000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b91a22-ee76-4851-b002-0065ca52daa3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.793253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:32.794974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:32.826799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.827474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.827814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.828091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.828771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:32.829078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:32.830494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:32.843198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 231/468] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:32.843887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.875292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.888961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 238/469] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:32.889725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:32.940713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:32.960489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b3a0b-46f7-44e6-8f28-188b2500d598 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:32.997040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:32.997663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:32.997917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:32.998193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:32.998834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.000276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.005134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18572-e9d6-4c33-9ad7-53e25d767bb4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.025344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 232/470] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:32 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:33.026146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.056176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.056738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.057031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.057277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.058147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.059497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.085950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 239/471] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:32 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:33.086920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.142111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:33.172193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118422c-1eb0-4422-9de2-734cc1407b25 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.223610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.224964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.226824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.227567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.230088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.234583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ec933-0d9e-47a6-a6a9-7595ba1c1830 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.248082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:33.253242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32a61-33a5-4f62-9c37-006ec5d02a64 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.277251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 233/472] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:33 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:33.279535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270517-5037-4c26-b2dc-6e65f0a6a7ff None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.280088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270517-5037-4c26-b2dc-6e65f0a6a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.280570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270517-5037-4c26-b2dc-6e65f0a6a7ff None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.282509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 234/473] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:33.290690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.291322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.291839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.310808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.311378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.311714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.311992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.315317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:33.317482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:33.332154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.333676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:33.353508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:33.354491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:33.355358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:33.355358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:33.355358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:33.355358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 240/474] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:33.361920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.433809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 235/475] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:33.457242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.514604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43353-851e-4df2-98c3-d02e2366348e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.558810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.560053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.560391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.560774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.561477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:33.561718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.563084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.571600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:33.576376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 241/476] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:33.582297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.601707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:33.627716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e2ed2-a0cc-4d99-b6b4-83e0b03e1222 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.677527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.678954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.679447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.679949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.681511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.683331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.696686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:03:33.696686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:03:33.696686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [parameters: {'id': '71f75be38be6474da1e9d3e56ab7384c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:03:33.696686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Aug 08 02:03:33.716621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:03:33.717749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:03:33.718690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:03:33.719569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:03:33.720445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:03:33.721313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'id': '71f75be38be6474da1e9d3e56ab7384c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:33.722120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:03:33.722933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.723894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 236/477] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Aug 8 02:03:33 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:33.725095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:33.727144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ca40-0f19-4c84-8a49-0ac85401ebb8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.766881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.767953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.768418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.768858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.769722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:33.771509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:33.799639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 242/478] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:33 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:33.905588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf543f-5098-4b64-a61d-04ea73ebde7d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:33.940746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:33.955828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:33.956760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:33.957182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:33.957594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:33.975036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b47d7175-ebce-4e0e-95f1-f54c4865d3e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:33.980537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:33.982237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:03:33.983196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:33.985365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 237/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:33.993769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:34.075492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:34.117100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8dcef-8022-4572-aa01-aea777062fbf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:34.156866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:34.157409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:34.157683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:34.157952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:34.158623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:34.158988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:34.160382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776061c-182e-482c-8917-456b40370dd8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:34.170019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 243/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:35.724577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fca0d-5da2-4b3d-b4f9-9b6818cd0789 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:35.725577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fca0d-5da2-4b3d-b4f9-9b6818cd0789 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:35.726059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fca0d-5da2-4b3d-b4f9-9b6818cd0789 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:35.727879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 238/481] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:35.737151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951cbe-5502-48c3-a14b-5e76af83b6c6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:35.737151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951cbe-5502-48c3-a14b-5e76af83b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:35.737151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951cbe-5502-48c3-a14b-5e76af83b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:35.761629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-df951cbe-5502-48c3-a14b-5e76af83b6c6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:35.763181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-df951cbe-5502-48c3-a14b-5e76af83b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:35.840968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 244/482] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:35.876031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fca0d-5da2-4b3d-b4f9-9b6818cd0789 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:35.910469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f723f-4cae-45dd-8839-9762b73e751c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:35.911078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f723f-4cae-45dd-8839-9762b73e751c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:35.911559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f723f-4cae-45dd-8839-9762b73e751c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:35.913390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 245/483] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:03:35.921759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3044a-f7fc-48c7-b529-538ad8ac2647 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:35.922321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3044a-f7fc-48c7-b529-538ad8ac2647 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:35.922785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3044a-f7fc-48c7-b529-538ad8ac2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:35.945198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d6a3044a-f7fc-48c7-b529-538ad8ac2647 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:35.946695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d6a3044a-f7fc-48c7-b529-538ad8ac2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:36.004126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.007329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fca0d-5da2-4b3d-b4f9-9b6818cd0789 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.019142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 246/484] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:36.020707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102654-7719-4e80-81ba-f93158c86d5e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.021161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102654-7719-4e80-81ba-f93158c86d5e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.021597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102654-7719-4e80-81ba-f93158c86d5e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.023210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 247/485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:36.029126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.029405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.029677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.050182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.051114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.051559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.052002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.062798 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:36.066787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:36.067982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:36.068338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:36.069206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.070018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:36.072417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 239/486] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:36.073357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.131002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.172801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 248/487] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:36.174684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.216877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4276-d40d-411c-a59c-075b761b424a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.265929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.266548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.266824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.267088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.278746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:36.283868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:36.284784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.285583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:36.289792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 240/488] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:36.290907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.302959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256d4e4-17e2-4d93-8b9c-f21ea0553359 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.324748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.341546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.342576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.343141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.343419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.344087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:36.344536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.346657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.360737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 249/489] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:36.361602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.411981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c80a9-b5b8-4c96-9849-372efc91d578 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.423011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.451849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.452631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.453030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.453395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.464874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:36.470205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:36.471270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:36.472286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:36.479050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 241/490] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:36.480444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.504941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2d3-2668-469c-90ed-314d698a975a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.553049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.554166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.554587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.554995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.555798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:36.556519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.558801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.570031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 250/491] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:36.570762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.597992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804bd5-a3b2-41a0-a98a-5867829e587d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.617232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.634157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.634777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.635051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.635313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.646103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.647551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bcdd84e1-fdd3-428c-bd99-f4067d972b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:36.662354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:36.663450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:36.664301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:36.664301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:36.664301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:36.664301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 242/492] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:36.664874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d30-638e-4cac-961f-acd25c54cd9e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.665174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d30-638e-4cac-961f-acd25c54cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.665413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d30-638e-4cac-961f-acd25c54cd9e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.668168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 243/493] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:36.669062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4d30-638e-4cac-961f-acd25c54cd9e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.677176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9ac-f160-473b-8fed-b8b69954f825 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.691631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.709996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.710590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.710863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.711128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.711786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:36.712084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.713477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c684e9-085c-448e-b5eb-8a3bdd8f699f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.722207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 251/494] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:36.723358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba3b3-727f-44da-b234-599b1f98c1fc None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.723640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba3b3-727f-44da-b234-599b1f98c1fc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.723905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba3b3-727f-44da-b234-599b1f98c1fc None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.728693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 252/495] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:36.728693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba3b3-727f-44da-b234-599b1f98c1fc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.777560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4d30-638e-4cac-961f-acd25c54cd9e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.810564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.811114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.811384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.811649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.821344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.822793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.828994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba3b3-727f-44da-b234-599b1f98c1fc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:36.835807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e2adf889-1d5e-4729-bcc9-2f753d012715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:36.839413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:36.840338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:36.841223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:36.841223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:36.841223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:36.841223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 244/496] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:36.841845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0dae-a5f1-4f07-92fe-a7f644d06cf1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.842127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0dae-a5f1-4f07-92fe-a7f644d06cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.842402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0dae-a5f1-4f07-92fe-a7f644d06cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.866108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7d8a0dae-a5f1-4f07-92fe-a7f644d06cf1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:36.867286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d8a0dae-a5f1-4f07-92fe-a7f644d06cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:36.868074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:36.868704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.868984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.869254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.869889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:36.870188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:36.872162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:36.883393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 253/497] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:36.884179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:36.935078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 245/498] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:36.936310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:36.936594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:36.937121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:36.942841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:36.956566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:36.957941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:36.989934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98ab9c-483a-4da2-bde0-aa49e5718a79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.023722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 246/499] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:37.024019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.024673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.024854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.024950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.025275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.041156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.042608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:37.056965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.057973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:37.059439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:37.059439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:37.059439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:37.059439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 254/500] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.060014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.081060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.130415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d3f25-dbc0-4a5d-a4f8-d3d22e5d875b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.159418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.164952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.165091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c86a1-8a25-48c4-81f1-b6442a09607a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.165559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.165833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.166098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.166732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.167036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.169093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.180297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 247/501] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.180944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.200656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.201308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.201585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.201854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.209224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.210652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:37.222882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.223848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 255/502] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.229828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.280019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea2a15-72c2-4439-87ac-7cb21548fe6e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.308146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.314461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.315155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.315426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.315699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.326170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:37.331282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.332151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:37.333015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:37.333629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a06b0-27b2-42d8-90e8-bfb8992cfc53 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.333699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 248/503] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.333699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.366167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.366787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.367064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.367332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.378924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.380386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.384873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:37.394725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.395609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:37.396443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:37.396443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:37.396443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:37.396443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 256/504] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.396970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.436410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3c47-5849-4dfe-915d-a9eb6609c6c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.469471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.470094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.470368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.470631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.471255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.471549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.472960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.485641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 249/505] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.486547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.498618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4137-9c58-49eb-8294-c894b4737337 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.526516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.533862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.534487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.534771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.535039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.542481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.544567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:37.555472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.556406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 257/506] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.557702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.590572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56240-90c3-463f-a9e4-ca78bbbd4f2d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.603497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.624522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.625164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.625439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.625709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.626427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.626728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.628176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.657633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c540e-94e6-4f83-b53f-7adc17c37ab9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.664269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 250/507] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.665116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.695961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.696562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.696879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.697147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.697807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.698107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.699487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.707299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 258/508] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.708079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.760527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.767378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2e4c-f1c7-4883-9594-f59394faa68f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.801799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.802402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.802673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.802944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.803587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.803892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.805315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.807603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f73a-aad5-476f-8dd3-8f85cd38c515 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.816214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 251/509] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.818217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.841489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.842044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.842323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.842589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.848019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:37.850248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.851684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:37.863455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:37.864504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 259/510] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:37.870341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.922109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db65b0-ffb2-47dd-bcd0-372ff326b964 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.955928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:37.956522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:37.956826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:37.957095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:37.957811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:37.958111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:37.959545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:37.967866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713a32-666b-48f1-a597-5cbc322ebc61 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:37.976931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 252/511] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:37.977725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:37.982068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.002076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.002679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.002956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.003227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.065023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.069115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.070555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.078307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f2779-b57d-4fe9-a767-2a5296d06a2f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.113305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.113819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.114096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.114360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.125398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.126864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:38.141579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:38.142623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:38.143866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:38.143866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:38.143866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:38.143866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 253/512] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:38.143866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.173855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 260/513] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:38.174794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.190441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.245703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8269-9148-4b19-aeb6-9004bf5b7eef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.274153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b603-58a1-49f9-a009-cc9ba42a232e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.278882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.279486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.279765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.280121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.280780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.282273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.293037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.303946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 254/514] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:38 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:38.305032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.322935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.323558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.323837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.324107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.324968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:38.325278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.326774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.368310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 261/515] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:38.369138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.433207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98e9c6-d2f8-4537-b070-757685e2140e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.455830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.475134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.475847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.476130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.476399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.494353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462f899-fa93-46fc-945c-1908d893c4a1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.534359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.534969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.535249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.535522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.536164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:38.536466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.537887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.550200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 262/516] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:38.551005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.551108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.563016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.564772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.662409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794e76-5e44-41b2-828e-a0befbae347b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.679350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 255/517] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:38.679350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.697305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.705934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.706571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.706852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.707136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.719463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.720952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:38.736513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:38.737588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:38.738470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:38.738470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:38.738470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:38.738470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 263/518] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:38.738739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.786027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:38.792589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7edec-b67a-47e7-aa9b-389bdd9e87c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.827676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.828309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.828546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.828846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.860422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95872b-d14a-43fe-826e-da62cddbefee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:38.896163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:38.896814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:38.897087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:38.897348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:38.900366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.901440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.905903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:38.907334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:38.918950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:38.920009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 264/519] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:38.920975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:38.965852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.010603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.023408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 256/520] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:39.023408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.034980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb272-ee71-4d2d-9902-ee47cdbcf39e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.072623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.073342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.073547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.073820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.085507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.086955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:39.102440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:39.103401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:39.109502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:39.109502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:39.109502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:39.109502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 265/521] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:39.109502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.137917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec580-8e30-4c34-89b4-0d065b3d588e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.178240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.178768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.179043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.179315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.179951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:39.180254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.181748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.197883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 257/522] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:39.197883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.212238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.219978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0dff0-f906-42b3-af6d-dc1c8fd73b15 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.253952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.254556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.254835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.255104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.255828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:39.256133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.257590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.258891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.275425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 266/523] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:39.276234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.311834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef8ea-373c-4cdf-bcc5-b5e45dc803d8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.348033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.348922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.349450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.349731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.361176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.362747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:39.377603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:39.378525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:39.379568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:39.379568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:39.379568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:39.379568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 258/524] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:39.379568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.387409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40098725-1541-4d5a-b1b1-dfa783fff953 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.429881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.430435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.430698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.431002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.431608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:39.431909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.433342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.445194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 267/525] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:39.451013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.469328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.493254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4aff8-8578-4a1f-9738-120266e85f00 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.502329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.529785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.530413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.530689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.531608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.537930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.539365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:39.551222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:39.552091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:39.553076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 259/526] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:39.554138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.566777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a64e7-1284-43ae-97f9-561c8de36bc7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.603567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.604178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.604452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.604750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.660672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08114f5e-9e6e-42fb-aade-c73f27d443ce None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.678071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.679635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.695184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.698016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.698630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.699222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.699575 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.700549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:39.700885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.702275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.716340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 260/527] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:39.720829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.750265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.789934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 268/528] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:39.791308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.830598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765556da-34f9-4b6c-b12f-74b1e0648e29 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.868547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.869861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.870282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.870706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.880051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.881731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:39.894246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:39.895251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 261/529] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:39.896281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:39.905214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769fc9-e258-49fd-9c70-762b36687b0e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:39.919310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:39.940588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:39.941212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:39.941489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:39.941760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:39.942447 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:39.942750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:39.944167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:39.961622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 269/530] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:39.962367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.006148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.019839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297ec8-e037-4737-b21f-001239884ae5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.054701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.055326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.055598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.055852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.063033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.064476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.066958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb5588-b0c1-41f9-b2fa-b32e4862dd10 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:40.075774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:40.076695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:40.077750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:40.084199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 262/531] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:40.084199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.109795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.110394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.110673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.111150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.122567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.124018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:40.140137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:40.141140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:40.142000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:40.142000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:40.142000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:40.142000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 270/532] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:40.142227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.170951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.200352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66036ee9-1734-470f-ad8e-029b13d2e684 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.238124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.238652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.238922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.239189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.239873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.240175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.241626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.252112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b69dc-422a-420d-9c20-cab364a1b480 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.259339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 263/533] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.260466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.272544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.292594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.293255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.294165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.294438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.295161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=1ac10759b62640d08ddbd86d1972b54f) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.295466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.296918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.302235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 271/534] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/role_assignments?user.id=1ac10759b62640d08ddbd86d1972b54f&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.303003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.404324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50d87c-6e3f-4bec-ac5a-a31d70e13735 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.407786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.425534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d1ef-42d2-4d8b-8fe6-75e632b76998 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.446930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.447541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.447819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.448087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.448818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.449126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.450686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.464393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 264/535] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.465641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.472547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.473186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.473967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.473967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.474628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.474925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.476280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5c80-b602-4a68-9d83-5addcbf67b37 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.490102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 272/536] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.492699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdd16-700a-4e76-b138-b0f7a494afd1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.492699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdd16-700a-4e76-b138-b0f7a494afd1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.492699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdd16-700a-4e76-b138-b0f7a494afd1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.497431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 273/537] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:40.497431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bdd16-700a-4e76-b138-b0f7a494afd1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.545914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.584585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcab52-ce4a-46a2-b02b-61a657570e21 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.602212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bdd16-700a-4e76-b138-b0f7a494afd1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.620891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.621805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.622083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.622349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.623064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.623366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.624886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2135e0-01c1-4ab9-a1b7-0d47b9189556 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.638803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 265/538] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.638803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.638803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.638803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.651409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.652043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.652320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.655813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.656666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=95fe28df0f1e4f9ca978a912bbffe4a6) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:40.656984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.657447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:40.658601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.659203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:40.672678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 274/539] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/role_assignments?user.id=95fe28df0f1e4f9ca978a912bbffe4a6&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:40.672678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.693282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.811912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 266/540] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:40.836373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.857908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0db44-b5a4-42e4-ae0a-8c85581cba9a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:40.900052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:40.900777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:40.901060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:40.901333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:40.909316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:40.910768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:40.911863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:40.940380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:40.941313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:40.942163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:40.946410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 275/541] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:40.952452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:40.975418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb26d-2bb4-4eb8-a69c-0ca9d8323a09 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.063143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.063725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.064004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.064271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.070566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:41.095317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:41.096491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32de11-dd6d-472f-8fd2-44e5b592fb5e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:41.100341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:41.101263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:41.102080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:41.109100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 267/542] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:41.114685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:41.136236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.137864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.138362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.138820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.139700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:41.140201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:41.141865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:41.154591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 276/543] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:41.160288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:41.276830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127aa73-5411-442e-a931-f1fa1304b510 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.314450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:41.321014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.322632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.322917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.323190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.323931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=ba51537c644043ae8c31655ad1b6426c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:41.325032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:41.327149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:41.333832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 277/544] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:41 2022] GET /identity/v3/role_assignments?user.id=ba51537c644043ae8c31655ad1b6426c&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:41.366636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11eafd-8639-4db7-8cf8-619cb2d635a1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.393919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:41.406730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.407618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.408037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.408441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.409311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:41.409749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:41.411280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:41.422283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 268/545] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:41.432606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:41.583567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e826b2-d826-4510-873e-2102e1b4164e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.627961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.628600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.628890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.629401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.646394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:41.647874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:41.664291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:41.665279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:41.666540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:41.666540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:41.666540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:41.666540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 278/546] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:41.671760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:41.781536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946278ff-5bbf-4e35-a264-efea5b75edb4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:41.816846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:41.817805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:41.818273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:41.818749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:41.819568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:41.820057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:41.821716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:41.835384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 269/547] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:41.841121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:41.939224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:42.009834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bf12-d9bb-4b78-84f5-c5ff292d4fec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:42.046852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:42.047483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.047760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.048032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.056103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:42.057597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:42.070332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:42.071313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:42.073321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 279/548] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:42.078403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:42.152673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:42.217628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7e17-08dd-411e-b899-5eac5baa4d29 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:42.257957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:42.258898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.259400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.259877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.260813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:42.261346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:42.263623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c98856-77c6-403c-81cb-878d1d2a51be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:42.282978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 270/549] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:03:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:42.288439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:42.454182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdc3f5-15f9-456b-acce-a3a8359f0b5b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:42.470994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:42.503739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:42.504353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.504632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.504924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.596098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:42.597588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:42.659991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008280be-4859-41be-99c8-b1244e6e0be9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.660620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008280be-4859-41be-99c8-b1244e6e0be9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.661105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008280be-4859-41be-99c8-b1244e6e0be9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.663010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 271/550] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:42.670147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.670703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.671176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.693762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:42.695489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:42.785227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 272/551] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:42.799645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 280/552] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:42.804193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:42.804506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:42.821916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:42.843567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:42.923458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803eee-68ec-45b4-b7d5-a8fb07527430 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:42.961096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:42.962192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:42.962666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:42.963172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:42.974751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:42.979851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:42.981937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:42.982808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:42.988935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 273/553] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:42.991424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.036939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456b39-b571-41c7-8e99-dc554d42be72 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.097282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.105323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c2b6-167f-45a3-8f53-5e8c11d8f02c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.107637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.108287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.108566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.108860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.129839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.131311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:43.154734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:43.155747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:43.156721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:43.156721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:43.156721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:43.157604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 281/554] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:43.163474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.164093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.164374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.164670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.165335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:43.165642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.167011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.168499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.188164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 274/555] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:43.194008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.254455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.315895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f514c-ed70-4370-b0b2-0a872d2552b2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.322596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98315d-7669-4dc5-928c-16b6ce557663 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.361395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.362127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.362412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.362802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.364441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.365548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.366443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.366911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.367761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:43.368273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.369909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e1e73-f45a-44c4-a6b1-1a6951534eda None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.379492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.381025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.392197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 282/556] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:43.392197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f76b5-3181-4e87-a8b2-5d4246c6b746 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.392197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f76b5-3181-4e87-a8b2-5d4246c6b746 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.392197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f76b5-3181-4e87-a8b2-5d4246c6b746 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.393741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 283/557] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:43.395358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f76b5-3181-4e87-a8b2-5d4246c6b746 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5de9b230-84c9-4bbf-9244-7907c7f65915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:43.400614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:43.402112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 275/558] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bce-3f96-4ada-8a92-95a085d39b5c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bce-3f96-4ada-8a92-95a085d39b5c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.404158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bce-3f96-4ada-8a92-95a085d39b5c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.405554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 276/559] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:43.406584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.407615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.407615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.422870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.428286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:43.430027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:43.501556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 277/560] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:43.502348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.530622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f76b5-3181-4e87-a8b2-5d4246c6b746 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.554710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.571047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.571790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.572071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.572369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.579715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.581316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5dba346c-3639-4dc9-aa15-a10e61e059e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:43.593936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:43.594954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:43.595836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 284/561] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:43.596331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.596796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.596796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.613391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460050e1-a07c-462e-a196-4f2d4a8f8ca2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.615981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:43.617207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:43.648172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.648809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.649085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.649349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.649980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:43.650335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.651641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.654604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.665791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 278/562] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:43.668222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.701178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 285/563] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:43.703075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.774662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5211b8c-1dd7-483f-bc07-6cec4e9f6334 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.806275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63966b7-046e-4906-b2e6-51029c187421 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.808134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.809419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.809742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.809980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.817080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.820222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:43.825928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:43.826869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:43.827719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 279/564] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:43.828420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.842698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.843295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.843849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.844119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.844828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:43.845127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.846530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.858835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 286/565] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:43.859644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.888478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:43.931936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c67335-124f-455c-ad9a-2b425c699ed1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.961187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6496-9a05-4e38-a701-cb81e332054c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:43.965822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.966445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.966718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.966985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.974163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:43.975847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0e03cbef-761d-4423-a868-225cb2167db2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:43.989018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:43.990168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:43.991332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 280/566] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:43.993837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beb44-c22c-4a38-9a83-8524334e5be5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.994227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beb44-c22c-4a38-9a83-8524334e5be5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.994503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90beb44-c22c-4a38-9a83-8524334e5be5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:43.996129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 281/567] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:43.997372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90beb44-c22c-4a38-9a83-8524334e5be5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:43.997634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:43.998264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:43.998541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:43.998809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.009966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:44.015309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:44.016401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 287/568] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:44.017282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.050304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.104795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90beb44-c22c-4a38-9a83-8524334e5be5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.119959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258f63-4aa7-40ae-ada0-e4365731fc2c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.120712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.139002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.139602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.139873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.140139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.140817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.141117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.142493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.151201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 282/569] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.153221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.155400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.156194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.156554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.157671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.158427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=30ea9dc686de47a3a860483a746025ca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.158737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.160169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906f0c6-1398-42dc-94f3-8f92d16f3938 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.166839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 288/570] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/role_assignments?user.id=30ea9dc686de47a3a860483a746025ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.167972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.168289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.168517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.192959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:44.195142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:44.268479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a2651-2a63-4b69-ace5-824d4ff4c622 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.281330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 289/571] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:44.281330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.311611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.314988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.315813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.316093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.316359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.316359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.316359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.318842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.343449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 283/572] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.345563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.384401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.395063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658c15-6fd2-40f7-ae83-95b58bb5af45 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.435499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.436106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.436378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.436685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.437325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.437624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.439246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.451512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 290/573] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.451512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.471608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107658-9842-435c-81f2-2a6589525d07 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.508858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.509500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.509775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.510044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.521444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.522967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:44.538729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:44.539687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:44.540602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:44.540602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.540602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:44.540602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 284/574] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:44.541274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.550982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.569378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ea72-8c6f-46ca-b865-09d6ae819133 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.604927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.606109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.606507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.606992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.617567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:44.623155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:44.624122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:44.625013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 291/575] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:44.625715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.649308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.663028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27b4a-e0cd-4b0e-9601-1a3887696537 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.698631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.699908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.700255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.700597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.714867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.716984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:44.731738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:44.732706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:44.733595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:44.733595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.733595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:44.733595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 285/576] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:44.733595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.744100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2167c-efd5-4097-bc40-a449f9c9b8ec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.781800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.782568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.782843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.783111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.795500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.797081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.804377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:44.819617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:44.820788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:44.821690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:44.821690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:44.821690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:44.821690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 292/577] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:44.823732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.841794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733c12-0672-4042-a89b-75db7ee668e7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.881594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.882205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.882483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.882753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.883396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.883698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.885114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.894974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:44.903520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 286/578] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.903520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:44.939504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8131-79a4-4df0-ad95-f3b898117c30 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:44.978388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:44.978992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:44.979263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:44.979881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:44.980580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:44.981411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:44.982793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:44.990878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 293/579] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:44.991825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.007882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce729-ccb4-4ae9-acff-870d63f4a9cd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.046298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.046900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.047174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.047440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.048069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.048366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.049759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.057600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.067189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 287/580] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.067189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.110373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c928a-a934-4e9e-80ff-62e0331264cb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.129174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.148143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.148775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.149049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.149316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.149944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.150240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.151635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.170060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 294/581] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.170060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.177530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd67589-4095-4ee1-ac24-72b62f8dbaa2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.210516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.211150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.211427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.211696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.219758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.221228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:45.233182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:45.234231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 288/582] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:45.235612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.282330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bc99-4e50-4228-93fb-d801d23b2bed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.304011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.320492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.321137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.321397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.321660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.332303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.333775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.345000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556778-9202-4e43-a967-14290307fed5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:45.348793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:45.349998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:45.350882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:45.350882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:45.350882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:45.350882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 295/583] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:45.351503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.373150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.388987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.389614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.389887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.390152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.397187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.398619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:45.412017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:45.412950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:45.413849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:45.416193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 289/584] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:45.417274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.469962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfabab-b2b7-4e7f-bb21-cc9f17274dc3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.507127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.507867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.508216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.508559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.516284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.517765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:45.528853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:45.529763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 296/585] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:45.530701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.536934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63a17-a529-4d97-840f-9b2b035c6c34 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.563850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.576040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.576973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.577403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.577674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.578397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.578701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.580121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.599866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 290/586] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.600471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.639873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4134e9-be59-42e3-a230-39985167bfdf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.644385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.675088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.675688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.675970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.676245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.676933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.677238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.678602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.691405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 297/587] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.691954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.715817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02777111-01ef-463c-92e9-e05adb0013a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.751408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.752008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.752279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.752546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.753247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.753551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.754964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.766589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 291/588] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.772102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.791042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.801178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaf607-a492-46a3-863b-69238947c9f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.835476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.836082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.836358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.836626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.837379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:45.837680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.839123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.858111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 298/589] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:45.858941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.883815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:45.889080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40029c-c113-492f-a4b2-84da7b952ba6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:45.926223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:45.926849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:45.927129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:45.927399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:45.938684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:45.940150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:45.954554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:45.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:45.956485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:45.956485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:45.956485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:45.956485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 292/590] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:45.956485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:45.972292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f436b-1485-4003-97fd-fe223dc8527a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.008553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.009197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.009474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.009739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.017050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.018500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:46.030318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.031257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 299/591] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.045586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.069216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cec4-c886-4e26-8711-4142822ca001 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.106046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.106968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.107337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.107700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/1ac10759b62640d08ddbd86d1972b54f/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.123761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=1ac10759b62640d08ddbd86d1972b54f, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.125331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.134415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.139474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 293/592] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:45 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/1ac10759b62640d08ddbd86d1972b54f/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:46.140566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.156774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1a61-4fc4-44ba-bcd2-8f45c140c6b3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.212611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.213796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.214418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.215579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.229276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.230917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:46.248152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.249411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:46.250434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:46.250434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:46.250434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:46.250434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 300/593] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.253973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.270415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703e1-a15b-43ed-9e1d-8cecf7bdcc8c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.314198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.314969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.315872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.316247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.317312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:46.317732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.319928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ad76-8298-4b95-9d96-a93bc30d0077 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.324021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.338024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 294/594] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:46.339294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256035-4d46-4327-8018-e4c1b7f6931f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.339577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256035-4d46-4327-8018-e4c1b7f6931f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.340409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256035-4d46-4327-8018-e4c1b7f6931f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.342122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 295/595] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:46.342687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256035-4d46-4327-8018-e4c1b7f6931f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.369068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc101d3b-a3e1-4cc7-be4b-9de026b755a5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.405102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.405937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.406406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.406677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.407475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:46.407711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.409165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.410012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.438045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 301/596] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:46.438045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.460576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256035-4d46-4327-8018-e4c1b7f6931f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.495628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.496209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.496490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.496792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.497432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:46.497731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.499098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002355b-ea7c-40cf-8565-b14d7a22ae19 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.514695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 296/597] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:46.514695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.514695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.514695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.530276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:46.531468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:46.550171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d233-5516-41d1-b5d9-5f2dc5753e0f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.572258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.588797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.589624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.590491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.590832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.598178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.599885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.601639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 297/598] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:46.602471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:46.627455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.628478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:46.629544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 302/599] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.633510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.660695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.713313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62f3b1-1f95-4701-93ac-7754966f3761 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.744510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ae774-65bd-41df-881a-7ed51876f94d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.752135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.753497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.753961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.754454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.769472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.771816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.780900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.781534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.781812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.782079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.788927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:46.790359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.791391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:46.792487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:46.792487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:46.792487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:46.792760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.798269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 298/600] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.798269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:46.807881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.809539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:46.810835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:46.815160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 303/601] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.815989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.866293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.902314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468add-ffee-489c-93fa-b367d4c01498 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.905176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:46.928363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397bd1-a581-4d10-bf4a-b008d3bdf467 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:46.939928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.940562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.940870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.941144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.952586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:46.957864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:46.958998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 299/602] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:46.965667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:46.976242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:46.976956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:46.977302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:46.977640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:46.978511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:46.978882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:46.980496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:46.997688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 304/603] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:46.998771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.065868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03438bb-5159-44a0-a384-1e586fb92533 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.102611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.102997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.103727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.103727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.104128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.104894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:47.105362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.106641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde734-160e-4f43-a545-43ba05c6553c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.107059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.120879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 300/604] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:47.121537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.146300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.154459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.155144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.155482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.155817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.156572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:47.156962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.158464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.175488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 305/605] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:47.175488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.234861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269eb49-f472-4a26-b5a6-1f947c1be323 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.274942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.275830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.276702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.277579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:47.278034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.279568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.280277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e864-a6b8-473e-8d7b-74abca89542b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.288258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 301/606] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:47.294061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.316092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.316700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.316985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.317256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/95fe28df0f1e4f9ca978a912bbffe4a6/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.333044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=95fe28df0f1e4f9ca978a912bbffe4a6, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.334484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.352698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 306/607] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:47 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/95fe28df0f1e4f9ca978a912bbffe4a6/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:47.352698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.378956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.399120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.417762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bf21-399f-4d66-9bf8-82c219c682d6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.459456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.460355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.460814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.461245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.468955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.470463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:47.483858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:47.484894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:47.485876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:47.490025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 302/608] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:47.491191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.506424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7a55-43b9-4891-897d-3903157ac415 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.553284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.554226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.554507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.554783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.579116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=dbdc6b9326be4f509f1c085d13187bc4, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.580797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.600473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 307/609] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:47 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:47.601350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.621857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9786d2-3852-450c-9d58-92fe4fe108c5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.662215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.663232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.663731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.664255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.676941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.678757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.682147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.687660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:47.705152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:47.706156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:47.707051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:47.707051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:47.707051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:47.709299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 303/610] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:47.716430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.760058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb11-cbef-4e94-8efd-adcea2a1b4f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.832120 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.833262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.833811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.834286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.835199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:47.835788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.837576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.851821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 308/611] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:47.857445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.883093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278287-ec5d-452c-843b-68c0f0d6a684 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.922518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:47.922909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:47.923188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:47.923458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:47.924104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:47.924459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:47.927745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:47.941075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 304/612] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:47.946978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:47.972489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d629f-96e1-4445-bc78-ffb6c29fe02e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:47.994777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:48.010685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.011403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.011903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.012172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/ba51537c644043ae8c31655ad1b6426c/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.013286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:48.030959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=ba51537c644043ae8c31655ad1b6426c, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:48.032663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:48.050485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 309/613] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:47 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/ba51537c644043ae8c31655ad1b6426c/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:03:48.067440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb628-bfa6-4559-9a58-7383fb5cf000 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:48.117656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.118231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.118511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.118783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.127924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:48.129454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:48.146621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:48.148053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:48.149041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:48.153296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 305/614] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:48.159423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.280206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051e4ff-e2d6-45b2-82ad-3ab806025fcf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:48.316062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.317070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.317543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.318029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.318943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:48.319439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:48.321080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9905004-2ac6-4a07-b1d8-0fd1673775fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:48.339519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 310/615] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:48.346363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.367376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71798-92ba-4b04-bd39-6e11fe49e16f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.368058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71798-92ba-4b04-bd39-6e11fe49e16f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.368529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71798-92ba-4b04-bd39-6e11fe49e16f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.370315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 311/616] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:48.376790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.377335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.377796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.404317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:48.405867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:48.432888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:48.513363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 312/617] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:48.530998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2f99-645d-4ff0-9f89-2351a56412f6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:48.548951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:48.556297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.594298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.594933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.595206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.595524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.619450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:48.620979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:48.651181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:48.652254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:48.653551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:48.653551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:48.653551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:48.653551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 306/618] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:48.659224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.721083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917649b-3819-4954-9c4d-385276dcd357 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:48.793516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.794347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.794627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.794903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.803484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356bbf1-e298-4fc8-9a9c-299aa236b9fa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:48.810516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:48.823342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:48.825004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:48.826069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 313/619] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:48.833113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.847949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:48.848688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:48.848971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:48.849550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:48.850190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:48.850487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:48.851847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:48.870331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:48.876366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 307/620] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:48.881694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:48.923614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:49.034422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1e836-061e-4381-bfeb-712a9edcbaa7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.052599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb3d42-d1c6-444e-9e20-17398164ef85 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.100360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.100990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.101268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.101538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.102205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:49.102506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.104157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.113668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 314/621] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:49.118895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.125565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.126140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.126415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.126680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.141591 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.143065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:49.165509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:49.168601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:49.170774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 308/622] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:49.176886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.290399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:49.317093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:49.332257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311462-b7bd-4dc0-bcc8-ade072f26c36 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.349129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190657e0-14f1-4277-b592-df4b8c4109f7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.377816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.378352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.378624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.378890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.379581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:49.379882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.381466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.395617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 309/623] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:49.402058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.438121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.438754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.439026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.439295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.464064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.466420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:49.502191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:49.503215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:49.504124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:49.504124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:49.504124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:49.506336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 315/624] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:49.518620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.646911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63a9d-562f-4d55-a268-24c86a795dff None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.718337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.719153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.719409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.719685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/30ea9dc686de47a3a860483a746025ca/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.722766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94b22d-1fb5-4faa-8915-984ad6b7ef61 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.736882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=30ea9dc686de47a3a860483a746025ca, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.738429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504175e-3f22-4695-bf8f-4f5a1476098f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.749149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:49.760389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 310/625] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:03:49 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/30ea9dc686de47a3a860483a746025ca/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:03:49.762145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee80e-9ca8-4ce5-b57a-afb22461b82a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.764225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:49.765294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee80e-9ca8-4ce5-b57a-afb22461b82a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.765618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fee80e-9ca8-4ce5-b57a-afb22461b82a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.769266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 311/626] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:49.770254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.771126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.771769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.772237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.773128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:49.773651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.775231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:49.775416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.775827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.776180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.790838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 316/627] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:49.796923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.801875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:49.802565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:49.888803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 312/628] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:49.910078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:49.927065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ecb2-927e-4de7-80b8-c9396fcebc43 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:49.970758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:49.972242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:49.972797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:49.973300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:49.983507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:49.985434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:50.001319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:50.002446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:03:50.003431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:50.006396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 317/629] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:50.021050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.091191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.094245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135603bc-cc7e-47ea-a8a7-9617b2b22576 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.129646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.141040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.142074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.142529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.142973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.143438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e89c-372a-496e-a4ab-349791c10d7a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.158874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ccbe6746-0e21-469c-a85a-0c1ac4803cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:50.165453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:50.166771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:50.167608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:50.170127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 313/630] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:50.171695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb224-c450-4248-8f5a-de84ebbbc616 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.171976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb224-c450-4248-8f5a-de84ebbbc616 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.172246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb224-c450-4248-8f5a-de84ebbbc616 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.173784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 314/631] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:50.178692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb224-c450-4248-8f5a-de84ebbbc616 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.188344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.189060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.189401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.189739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.190582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:50.191286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.193378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ddac-a342-40af-885b-6f1c530254cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.213170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 318/632] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:50.215405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.215841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.216267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.236080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:50.237543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:50.298646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb224-c450-4248-8f5a-de84ebbbc616 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.320940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 319/633] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:50.322832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.338164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.339113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.340296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.340957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.341871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:50.342481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.344200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.354210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 315/634] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:50.363973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.383013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.421038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.466771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8032f4-6c73-497e-a96b-2b78253416df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.480730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b953-58d2-4e08-9370-3fa6b12df318 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.515491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.516448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.516942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.517116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.517626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.517731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.517993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.518263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.530069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.531544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:50.546502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:50.547485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:50.548373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:50.548373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:50.548373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:50.548373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 316/635] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:50.548373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.599823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.601319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a31c4-fce3-4c15-8165-d1d673f4dd76 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.646807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.659796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a482-9595-4af0-baf1-4354ea1bcc27 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.661593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.696529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.697104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.697375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.697641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.707963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:50.711347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 320/636] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:50.712581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:50.713551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:50.714416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:50.715575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa4af2-078a-4d61-a78e-ae62b063a8ac None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.715996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa4af2-078a-4d61-a78e-ae62b063a8ac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.716398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa4af2-078a-4d61-a78e-ae62b063a8ac None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.717866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 321/637] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:50.718453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 317/638] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:50.718873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa4af2-078a-4d61-a78e-ae62b063a8ac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.719279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.828077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa4af2-078a-4d61-a78e-ae62b063a8ac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.828285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2556-c7ac-4320-8158-0486a9a5b22c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:50.864114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.864741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.865023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.865296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.865966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:50.866239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.867656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.867819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:50.868424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.868748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.869100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.877318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:50.880182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:50.885044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:50.885878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 322/639] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:50.886904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a36f5a96-bec4-4b04-8dbf-16fe72567c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:50.899373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:50.900327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:50.901264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:50.901264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:50.901264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:50.901264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 318/640] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:50.902267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:50.902267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:50.902267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:50.920239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:50.921477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:50.931310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.000762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 319/641] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:51.000762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.012427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8e0b-2779-4409-acf8-fb088e924c7a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.049490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.050369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.050646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.050914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.051585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.051885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.053283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.062815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 323/642] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.063855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.118800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea878-4899-4eef-af18-0cc95f37ad4d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.134873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.156605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.157401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.157680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.157946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.165658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.167226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.179978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00ffb7-2fe9-492e-b360-36005bcf8f60 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:51.180151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:51.181143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 320/643] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:51.186690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.190393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.223343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.224056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.224678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.224972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.225616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.225927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.227285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.244607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 324/644] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.244607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.296369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaba3b-db6f-4e5a-92d9-c64c92347456 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.329631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.330544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.330845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.331185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.341868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:51.347015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:51.348108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:51.349557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:51.352535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c3171-1e5a-40a0-828b-5ad2f9f611bd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.353447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 321/645] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:51.354279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.378900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.392285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.393057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.393432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.393800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.405439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.407073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.424253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:51.426296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:51.427448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:51.428420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:51.428420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:51.428420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:51.432802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 325/646] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:51.434598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.469444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268755d-7802-418a-9d4c-9bf3d4b6556d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.504384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.505035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.505314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.505583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.506315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.506616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.508043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.529858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 322/647] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.529858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.547548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d09f8-ada7-49ec-9246-e4aa61fbe768 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.583296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.584016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.584369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.584745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.592048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.593636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:51.606286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:51.607392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:51.608292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 326/648] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:51.608813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.638925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11cf2-aa66-412d-8b75-962a88a2df81 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.646086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.663631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.678316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.679086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.679364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.679633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.680821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.681412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.682948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.698329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 323/649] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.698329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.713951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91218cf-e5c0-42d4-951c-35cbb28f606d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.749258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.749863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.750139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.750409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.751052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.751346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.752725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.764508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 327/650] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.764508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:51.816836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae803ba-ce61-4f29-a1cf-d728b808a4cc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.852982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.853758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.854035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.854302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.873842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.882786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b59c-6b44-48b2-86de-9c92a72f442f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:51.909164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:51.923955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:51.924560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:51.924864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:51.925145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:51.925825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:51.926126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.927608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.927844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:51.929326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:51.940222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 328/651] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:51.940987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.038489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 324/652] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:52.039350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.052245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ba3a-c401-4d39-9386-34112c3bddb1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.085393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.085930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.086202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.086468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.097606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.099070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:52.113932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:52.114946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:52.115849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:52.115849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:52.115849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:52.115849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 329/653] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:52.115849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.124698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.127599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.144784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1eb1-8df8-433a-9668-f6e3723a789c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.178759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.179387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.179646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.179920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.186818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.188319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:52.201387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:52.202358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 325/654] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:52.203888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.221343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2093ee-2a6a-4455-b2e5-73681579109a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.254987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.255587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.255867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.256134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.256930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=1ac10759b62640d08ddbd86d1972b54f) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:52.257243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.258692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a292da-0927-4a90-bb26-e8923e99ccb1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.265042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 330/655] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/role_assignments?user.id=1ac10759b62640d08ddbd86d1972b54f&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:52.266390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b104-f192-4df6-830a-734db2f72e55 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.266783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b104-f192-4df6-830a-734db2f72e55 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.267154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b104-f192-4df6-830a-734db2f72e55 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.268775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 331/656] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:52.269624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b104-f192-4df6-830a-734db2f72e55 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.321847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fa63-d13c-46f8-8b8d-f21db028b9b1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.358352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.362383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.363067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.363410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.363758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.376101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.377649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.381111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:52.395477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:52.396522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:52.397843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:52.397843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:52.397843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:52.397843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 326/657] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:52.397843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.404441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b104-f192-4df6-830a-734db2f72e55 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.455066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.456078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.456078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.456248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.457288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:52.457288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.458591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bbf22-6ef5-46fa-893d-2f906a60d300 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.472398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 332/658] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:52.473751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.474030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.474726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.495481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:52.497149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:52.519857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33062249-a986-49ae-8ca7-f7ba43692bc2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.557174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.557779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.558055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.558354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.559084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:52.559384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.560846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.576579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 333/659] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:52.577732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.582897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 327/660] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:52.583859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.644380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.656605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.693486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986396e-b04b-4769-b186-dbd5bf777927 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.701653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d926f7-0bfa-4faf-b1d1-03129de05c91 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.733865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.734498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.734797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.735070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.739891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.740699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.741119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.741530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.742345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:52.742554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.742937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.743994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.744803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:52.755586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:52.756736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 328/661] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:52.757703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.759691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 334/662] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:52.760634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.872913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71827a55-7038-48ba-bde5-e6c67ab971b9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.873929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad13524-30d2-4d7f-b944-e2fce205dc04 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:52.889761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.895130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:52.911359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.911999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.912276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.912547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.913680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:52.914607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:52.915316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:52.915763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:52.923016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:52.928108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:52.929365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:52.930229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 335/663] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:52.930930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:52.995680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:52.997354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.037493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410afc3-7f2f-4abc-9d69-be28984d63e9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.074771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.075468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.075748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.076011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.076771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:53.077061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.078490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.097240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 336/664] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:53.097897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.113950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 329/665] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:53.114983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.130739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.150376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.215223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf76-c111-48e6-8def-a2335decfeec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.230742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e426d91-3449-4d80-a626-53b6746eb83b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.256804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.257541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.257881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.258216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.265950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.266876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.267538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.267659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.267941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.268211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.268886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:53.269182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.270620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.283238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 330/666] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:53.283417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:53.284505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:53.285682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:53.286234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.286323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:53.286323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.368182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.394736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7896b-37c1-4438-b13e-7e58922af2ec None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.394981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.398918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3da74-2ccf-466d-8e6f-d274e9a8057a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.439704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040747ae-a076-448d-9380-8743e29df475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.440330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040747ae-a076-448d-9380-8743e29df475 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.440604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040747ae-a076-448d-9380-8743e29df475 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.440919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040747ae-a076-448d-9380-8743e29df475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.441476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.442078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.442352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.442618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.522901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.524373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.568987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040747ae-a076-448d-9380-8743e29df475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.570424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040747ae-a076-448d-9380-8743e29df475 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-040747ae-a076-448d-9380-8743e29df475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:53.585323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:53.586308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:53.587274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:53.587274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.587274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:53.587274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 338/668] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:53.587274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040747ae-a076-448d-9380-8743e29df475 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.611001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.638051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 331/669] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:53.643019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.690517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040747ae-a076-448d-9380-8743e29df475 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.723410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.724037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.724578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.724867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.736068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.737576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.744174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bb85d-da0a-4a07-9adb-22ae2a4a4559 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:53.752461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:53.753456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:53.754363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:53.754363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.754363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:53.754363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 339/670] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:53.754363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.758709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.788279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.788913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.789182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.789453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.790135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:53.790432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.791850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.805281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 332/671] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:53.806402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.844220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:53.869765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a941b6-67cd-4c58-a39c-23c0d9ae1949 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.906469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.907345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.907775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.908200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.908998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:53.909446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.910936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.911604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de747-bcef-42a2-aaf7-afc1c1e9b622 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:53.927884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 340/672] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:53.927884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.953168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:53.953726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:53.954000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:53.954269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:53.965477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:53.966919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:53.981793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:53.987489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:53.988676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:53.988676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:53.988676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:53.988676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 333/673] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:53.988676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:53.998662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.040037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74544-4442-48bc-b2ef-f6a864940cd7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.074635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.075248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.075529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.075808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.076455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.076787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.078158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.087085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.092363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 341/674] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.093429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.106016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317caa-7b53-419d-b8de-d0796284ed07 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.143266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.143872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.144151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.144420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.145177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=95fe28df0f1e4f9ca978a912bbffe4a6) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.145478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.146918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.153647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 334/675] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:53 2022] GET /identity/v3/role_assignments?user.id=95fe28df0f1e4f9ca978a912bbffe4a6&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.157576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.205792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2b12e-1c8d-4015-a639-139dba991c1d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.237260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.252197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.252865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.253254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.253619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.261876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.263474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:54.276240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:54.277995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:54.279102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:54.285391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 342/676] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:54.286483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.320109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c78cc-4c65-4e3e-a115-e6bb9a292844 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.366817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.367432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.367709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.368708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.368708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.368937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.371100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.387746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 335/677] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.388855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.411318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.419974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c424112-e3ef-4c45-af61-494ef5a249c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.455738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.456672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.456672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.456930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.464081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.466320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:54.478151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:54.479126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 343/678] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:54.480195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.518124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a058f8-0e39-45e7-81d5-d07af85db2fa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.530046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.596023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb54645-6476-483a-a88a-9c38c737d5c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.634172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.634905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.635308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.635644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.643185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.644756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6ce5623a-3883-4968-a883-35f1c94ef379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:54.656516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:54.662397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 344/679] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649474c-f8e9-4ecc-b5eb-a2b06673c5d4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.663335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649474c-f8e9-4ecc-b5eb-a2b06673c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.663945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649474c-f8e9-4ecc-b5eb-a2b06673c5d4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.663945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 345/680] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:54.663945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649474c-f8e9-4ecc-b5eb-a2b06673c5d4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.682964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.683747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.684093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.684441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.685249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.685626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.687129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.701935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 336/681] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.702873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.779888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649474c-f8e9-4ecc-b5eb-a2b06673c5d4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.781393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.781946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:54.815557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5602-0b18-4922-91e1-960d04423684 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:54.821093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.821858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.822299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.822732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.823453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.823779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.825949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f850b-6acf-4ba0-b369-66996a1e554d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.844512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 346/682] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.846069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.846579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.847058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.858776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:54.859386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:54.859660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:54.859956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:54.861100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:54.861403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:54.862830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:54.866089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:54.867382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:54.875995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 337/683] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:54.876857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.946389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 347/684] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:54.947568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:54.984633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094bc1-42c7-44c1-b9f9-694bc9610a7c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.014885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.021966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.022761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.023199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.023673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.024389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:55.024724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.026148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.041155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 338/685] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:55.043167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.057805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.070247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9661-a2d2-4e76-9982-1933b499e784 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.112218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.112972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.113416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.113573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.185222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04f81c-2ab4-47ba-b45a-b9a529139623 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.205972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.207529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.233234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.234165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.234629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.235081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.235984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=ba51537c644043ae8c31655ad1b6426c) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:55.236515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.238085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.246901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 339/686] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/role_assignments?user.id=ba51537c644043ae8c31655ad1b6426c&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:55.247723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.326222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.360128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.378343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 348/687] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:55.384695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.401382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b71-7c1a-4dd5-a3a5-efbcd2a1ff2f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.451020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.451668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.451938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.452201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.466833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.467706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:55.485368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:55.486397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:55.487313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:55.487313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:55.487313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:55.487313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 340/688] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:55.493221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.524940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dbca6-d7ad-4c10-b055-19e0b4037365 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.568316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.569420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.569905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.570399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.583026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.585103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:55.602030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:55.603055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:55.603948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:55.603948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:55.603948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:55.606675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 349/689] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:55.612311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.632374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949015c3-0e7c-47ba-a445-60dd2e645ce7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.648020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.667066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:55.675763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.676383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.676677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.677012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.677664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:55.677969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.679348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.692229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 341/690] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:55.697437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.744382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963608-7083-4c21-b4da-8f207839d094 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.807564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.808728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.809013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.809280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.809942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:55.810247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.811619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.835121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 350/691] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:55.842176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:55.847061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7fd93-4c55-405d-9ac2-36c58ef57d51 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:55.912100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:55.912752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:55.913032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:55.913303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:55.913946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:55.915390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:55.946637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 342/692] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:03:55 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:03:56.048483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3ce2-4824-4e61-874e-11777e330853 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:56.050119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:56.099077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:56.099998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.100282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.100580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.112167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:56.113687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:03:56.130167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:56.131203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:56.132740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 351/693] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:56.137800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:56.180153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:56.259031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb641f-6b18-4714-a7ac-ac1b64c64b70 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:56.295360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:56.295976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.296264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.296536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.297309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:56.297613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:56.299056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c5f1f-369b-4626-be1c-42b946570293 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:56.312849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 343/694] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:56.318472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:56.376806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503cf6-a26f-46d8-9acc-e370feeb8f25 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.377318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503cf6-a26f-46d8-9acc-e370feeb8f25 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.377418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503cf6-a26f-46d8-9acc-e370feeb8f25 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.379179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 344/695] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:56.391472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.391764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.392021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.410863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:56.412581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:56.456989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a791c-c1cc-405b-b7f6-79fc3b71864d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:56.493684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757135-1073-444d-9be9-c31893a088df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:56.494303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757135-1073-444d-9be9-c31893a088df None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.494569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757135-1073-444d-9be9-c31893a088df None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.494844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757135-1073-444d-9be9-c31893a088df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.495591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757135-1073-444d-9be9-c31893a088df None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=30ea9dc686de47a3a860483a746025ca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:56.496126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757135-1073-444d-9be9-c31893a088df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:56.497505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 345/696] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:56.500669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757135-1073-444d-9be9-c31893a088df None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:56.504373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 352/697] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:03:56 2022] GET /identity/v3/role_assignments?user.id=30ea9dc686de47a3a860483a746025ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:56.519929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:56.541249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:56.632911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc3a2-98f3-488a-af61-242a612e3b4b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:56.692411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:56.693140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.693413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.693678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.694272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:56.695738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:56.710024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:56.711130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:56.711967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 346/698] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Aug 8 02:03:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:56.719448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757135-1073-444d-9be9-c31893a088df None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:56.765038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:56.867673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757135-1073-444d-9be9-c31893a088df None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:56.907951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:56.908926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:56.909406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:56.909877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:56.910713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:56.911227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:56.912847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0811f-38be-4966-9714-369c46c3afbb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:56.918233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 353/699] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:03:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:56.924004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:57.020793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:57.041678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412a1e3-b939-4d69-8005-39ae2816dd8f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:57.081294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:57.081866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:57.082138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:57.082671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:57.083367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:57.083754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:57.085379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f97c2-f7ae-4165-8ade-7bc66cdb796d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:57.093030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 347/700] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:03:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:57.615923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c8e6-b550-4971-93a8-234ef083e204 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:57.616664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c8e6-b550-4971-93a8-234ef083e204 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:57.617150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c8e6-b550-4971-93a8-234ef083e204 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:57.618902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 354/701] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:57.625653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0c14-c4c8-411f-95a2-129e23fe4f28 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:57.626525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0c14-c4c8-411f-95a2-129e23fe4f28 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:57.627053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0c14-c4c8-411f-95a2-129e23fe4f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:57.653969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-203a0c14-c4c8-411f-95a2-129e23fe4f28 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:57.655514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-203a0c14-c4c8-411f-95a2-129e23fe4f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:57.794464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 348/702] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:03:57.842151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15c8e6-b550-4971-93a8-234ef083e204 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:57.854218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded6a8-0126-4029-a7ad-5c01f8bf22c7 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:57.854496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded6a8-0126-4029-a7ad-5c01f8bf22c7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:57.854769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded6a8-0126-4029-a7ad-5c01f8bf22c7 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:57.856184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 349/703] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:57.863263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:57.863549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:57.863820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:57.899974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:57.901202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:58.037294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.057132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 350/704] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:58.062231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15c8e6-b550-4971-93a8-234ef083e204 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.112886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.113521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.113799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.114070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.122930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.131177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.145845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:58.150563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:58.151588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:03:58.152501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:58.163724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 355/705] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:58.166685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.332854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21a5d-467d-4eca-810e-fedc8cd56304 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.380126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aced62-1d54-4ca9-9b10-0221866c6a06 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.409523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.410174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.410454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.410725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.411312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:58.422774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:58.441647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:58.442714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:03:58.443544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:58.453875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 351/706] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/services/network => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:03:58.455993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.473379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.474584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.475170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.480992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.482055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:58.482677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:58.484245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:58.517768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 356/707] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:58.519040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.545002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.614248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.670162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c7c9-d9e0-4883-bd74-1cdf433bdfc5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.684163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68fe89-6300-4153-895b-f71f906e8e3a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.743464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.744076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.744350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.744616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.745267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:58.746194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:58.747628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:58.753082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.753703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.753973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.754234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.761829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 352/708] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:58.766132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.779581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:58.781168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:58.813634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:58.814635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:58.815546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:58.815546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:58.815546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:58.815546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 357/709] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:58.820301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:58.925076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02285-815a-4448-ae56-0186cf40c151 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:58.949774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.961368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:58.961913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.962199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.964918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.964918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] RBAC: Adding query filter params (type=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:58.964918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:58.965359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c51df-dc3e-4fe1-ae65-0552b7469afc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:58.966820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:58.977129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 353/710] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:58.978536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4e6a-b023-496f-befb-193cd8b85fcf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.978825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4e6a-b023-496f-befb-193cd8b85fcf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.979103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4e6a-b023-496f-befb-193cd8b85fcf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:58.980883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 354/711] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:58.998188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:58.998499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:58.998745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.032131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552e6b-717f-4f17-8cc6-caabc877a51e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.037981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:59.039218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:59.086430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.087050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.087409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.087684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.088373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:59.088767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.090141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.118404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 358/712] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:03:59.126953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.137167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 355/713] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:59.156971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.251416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612fb54-11d9-4443-8e4c-197bacead123 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.277582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.287476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23943c4-b6fd-4fe2-af21-f88724cbc290 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.296792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.297443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.298301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.298579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.312956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.315257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:03:59.336555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:59.337658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:03:59.338632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:59.342387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 359/714] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:59.345019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.349598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.356781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.357420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.357693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.357960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.391782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bc9eb750-bc0b-4d9d-b78b-bf87013e46b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:03:59.396513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:59.397602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:03:59.398457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 356/715] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:59.399170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fed03-2a2b-4428-afa7-b993b75ae7b4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.399493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fed03-2a2b-4428-afa7-b993b75ae7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.399623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fed03-2a2b-4428-afa7-b993b75ae7b4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.401676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 357/716] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:59.406393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fed03-2a2b-4428-afa7-b993b75ae7b4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.499656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488f6d-6912-4961-abfa-6ce056cd0ce2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.539866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fed03-2a2b-4428-afa7-b993b75ae7b4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.547334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.548056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.548458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.549278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.550083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:59.550451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.552362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c105f2-446f-4898-bc47-511c877c87b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.573089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 360/717] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:59.575348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.575842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.576323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.588856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.590197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.590484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.590762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.591489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:03:59.591801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.593686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.597392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:59.599149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:03:59.610307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 358/718] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:03:59.610307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.642055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.684671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 361/719] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:03:59.684862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.686376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.743631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752de9-b03d-4e0b-bfe0-b981fa46d9c9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.779671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.780335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.780632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.780927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.797657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ffd2-2d16-451a-a7b3-8676514a1cce None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.834374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:03:59.835118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.835399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.835665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.846532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.847991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.861178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:03:59.862670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8280-e707-4dd2-a7bb-fd1d2f71f199 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7ead03a6-74b8-4268-a3af-493ccfaf4351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:03:59.865239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:03:59.866201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:03:59.867094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:03:59.867094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:03:59.867094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:03:59.867094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 362/720] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:03:59.867597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a1a9-87a8-4473-ba25-1107c556da7d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.867835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a1a9-87a8-4473-ba25-1107c556da7d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.868108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039a1a9-87a8-4473-ba25-1107c556da7d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.869639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 363/721] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:03:59.870338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039a1a9-87a8-4473-ba25-1107c556da7d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:03:59.899358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.920605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:03:59.978854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 359/722] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:03:59.978854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:03:59.978854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:03:59.978854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:03:59.991735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039a1a9-87a8-4473-ba25-1107c556da7d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:03:59.994437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:03:59.995729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:00.028137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.028792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.029067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.029332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.039521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:00.045583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:00.046542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 364/723] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:00.047395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.074255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 360/724] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:00.085558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.141392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.160115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371aef-7f14-48b2-b0c0-c019278b67fb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.174149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.194976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c7d57-3c36-495a-a700-940b5b2d79b5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.196504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.197145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.197486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.197763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.198407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:00.198864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.200300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.216776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 365/725] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:00.216776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.238720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.239687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.240156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.240599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.255515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.257363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:00.274333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:00.275367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:00.276375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:00.276375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:00.276375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:00.276375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 361/726] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:00.276375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.332016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a90390-c0a1-43b4-9987-d1799ad064ce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.369752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.370350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.371338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.371834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.372520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:00.373202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.374342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.385004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dafb4d-a279-4c5c-a5fe-aebd5344c037 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.388775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 366/727] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:00.389678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.398643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.421691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.430347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.430981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.431259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.431551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.432164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.435093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.453286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 362/728] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:00 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:00.454653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.529924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c66-5c91-4803-b44c-287da0f83a12 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.590043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.590994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.591301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.591575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.600578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.602216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.612168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ee80-bd98-4db4-bcf3-1f607ded3e14 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:00.615211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:00.616152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:00.617136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:00.617669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 367/729] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:00.618187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.654801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.656016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.656332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.656625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.658118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:00.658403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.659777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.674501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 363/730] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:00.676767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.696882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.740586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c50c4-7bec-43e0-a002-bf3f85382f11 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.771031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.778369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.779279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.779765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.780231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.791609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.794004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.799670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bf6b-927f-4f9b-b382-a76a2e5487b1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:00.810427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:00.811387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:00.812271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:00.812271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:00.812271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:00.818683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 368/731] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:00.819807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.836744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.837611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.837797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.838071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.838807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:00.839109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.840722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.864725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 364/732] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:00.864725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:00.933560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81213fc-6285-42a9-a47f-022ecaef7503 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.948515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:00.971017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:00.971579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dde8e-61dc-4e2e-9fc2-15aa417ce6b4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:00.972283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:00.972809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:00.973353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:00.981592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:00.983295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:00.995013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:00.997501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:00.998386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:01.000700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 369/733] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:01.001690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.005401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.020153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.021357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.021804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.022521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.023678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:01.024127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.026264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.046319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 365/734] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:01.046319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.132385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8c3d-74e0-49f6-a0d7-d1c42b6b416c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.171373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.172404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.173006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.173484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.176861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5d2aa-500a-4ae9-8556-ce8f9d57a030 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.217084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.217703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.217981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.218254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.218939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:01.219249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.221976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.222090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.234861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 366/735] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:01.235696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.256185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.257746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27ea3c-77a9-4f96-be6b-7b40070b8ccf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.270855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.344887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa6437-2ad2-49bc-9a3b-c1b65299c276 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.375118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 370/736] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:01.376336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c607e0-539c-4ed9-ad12-f7b75ce35aef None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.376622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c607e0-539c-4ed9-ad12-f7b75ce35aef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.376927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c607e0-539c-4ed9-ad12-f7b75ce35aef None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.378316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 371/737] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:01.378847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c607e0-539c-4ed9-ad12-f7b75ce35aef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.389161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.389816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.390100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.390370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.397962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.399398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:01.411577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:01.412534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 367/738] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:01.413561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.472224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.500857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c607e0-539c-4ed9-ad12-f7b75ce35aef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.510975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.521899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72e12-9385-422d-9c9c-e8d31dd251d7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.538581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.539221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.539452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.539720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.540615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:01.540835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.542204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7581b-a4e8-4131-9bd5-89c90ac1cee6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.556685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 372/739] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:01.556685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.556685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.556685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.571042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.571830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.572185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.572525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.576042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:01.577553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:01.585644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.587216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:01.602944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:01.603982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:01.604956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:01.604956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:01.604956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:01.609075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 368/740] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:01.610087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.660252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 373/741] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:01.661571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.754199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.759331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b415-5ec5-485b-87de-403061cbe2b5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.795525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.796230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.796457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.796753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.797583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:01.797816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.799235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.800003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac56f34-1680-4c53-898e-1fe1af37603e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.815003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:01.819268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 369/742] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:01.823897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.849080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.850076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.850443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.850804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.851540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:01.851934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.853406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:01.865282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 374/743] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:01.866323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:01.947576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6395e7-31f6-4344-b356-50346b95046d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.968491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed977-d6fa-44a3-adc1-741eecde0d9b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:01.984690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:01.985518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:01.985968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:01.986371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:01.987303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:01.988851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.001072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.006635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 370/744] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:01 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:02.007884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.017094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.019231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.025225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.025917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.162852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.187421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.188979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.215896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc50ab-4c80-42a5-92fb-4096ed9c05be None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:02.252584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.253256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.253537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.253811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.261637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.263351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:02.275325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:02.276258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:02.277814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 371/745] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:02.283035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.299790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 375/746] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:02.305389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.336779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.396590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492e29-ec76-4ea3-a91d-7684400daa07 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:02.431735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1979a-6418-4550-9a55-5b2cf9a4b0cf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:02.432349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.457488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.458209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.458494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.458765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.459462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:02.459871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.461429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.477186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.477747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.478022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.478288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.488593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 372/747] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:02.492271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.494568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.498973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:02.528129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:02.529193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:02.530092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:02.530092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:02.530092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:02.534940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 376/748] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:02.535795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.660217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703375d-e73b-4ebd-b941-ae235c571230 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:02.668285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.695955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.696561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.696870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.697141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.697305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634bbd-3bb0-49d1-a5d1-f19f62817380 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:02.697864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=85122d5f39df41b08d41c51ae931b3ca) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:02.698171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.700319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f728-caf5-4169-9290-4273ebcc7b42 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.706420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 373/749] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/role_assignments?user.id=85122d5f39df41b08d41c51ae931b3ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:02.707637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e627-6878-443a-8dcb-2e1c77486e91 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.707922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e627-6878-443a-8dcb-2e1c77486e91 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.708194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e627-6878-443a-8dcb-2e1c77486e91 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.721731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 374/750] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:02.728537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.729215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.729701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.766001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:02.767006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:02.767472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:02.767929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:02.768188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:02.769041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:02.769482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:02.769796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:02.771412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:02.787417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 377/751] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:02.796409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:02.873096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:02.908945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 375/752] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:02.930281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.046681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68d0b-c726-4af6-a136-90a0eb7ff5ae None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.047858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c09609-f867-47e8-be3f-d2b027f2abdc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.091702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.092801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.093291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.093796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.094589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.096443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:03.107318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:03.108380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:03.109674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:03.117076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 376/753] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:03.119259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.184878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.185584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.185869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.186141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.189209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:03.197578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:03.210618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.212703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:03.239344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:03.240346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:03.241292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:03.249126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 378/754] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:03.251331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2473a0-8dc8-44da-a7b1-5af9d842c66e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.254427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.302613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.303624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.304979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.305462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.309676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:03.310235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.311837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.330079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 377/755] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:04:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:03.338682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.467404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d5ba-87d0-4a99-81a7-6fe94195acaf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.515030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.516084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.516567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.517063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.517962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:03.518466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.520139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.535164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 379/756] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:03.541118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.609642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:03.670043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389df319-fced-46db-9f63-3dee6c52a857 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.674207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:03.678994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2bc4b-8200-43e7-8ed4-343bb97de9c2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.747146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.748218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.748773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.749243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.750620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:03.750620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.751730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.763286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 378/757] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:04:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:03.769330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:03.769705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:03.769957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.770242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.770516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.771477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=30ea9dc686de47a3a860483a746025ca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:03.771960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:03.773698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09557a-eaef-4836-9d3d-3470c2dc9fd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:03.791938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 380/758] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:03 2022] GET /identity/v3/role_assignments?user.id=30ea9dc686de47a3a860483a746025ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:03.918505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e90bc9-3885-4ebf-af71-0b754a7d55f5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:03.937863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3e16-f10c-452b-bd25-d492ba6be4f0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.937863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3e16-f10c-452b-bd25-d492ba6be4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.937863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3e16-f10c-452b-bd25-d492ba6be4f0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.940112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 381/759] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:03.949093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:03.949093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:03.949511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:03.971785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:03.973546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:04.007513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.009203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.010029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.010846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.012700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] RBAC: Adding query filter params (interface=public, service_id=9b95b50e57684f98b1d5998c21125ebd, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:04.015607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:04.018546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:04.043083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 379/760] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:03 2022] GET /identity/v3/endpoints?service_id=9b95b50e57684f98b1d5998c21125ebd&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:04.049601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.087942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:04.100539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 382/761] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:04.131336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.217221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61ac-bd93-43ec-a863-088b9b407074 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:04.229869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:04.265148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.266147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.266621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.267186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.268008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:04.269622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:04.275906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 380/762] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:04.324236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd8521-f895-4ae0-9440-7ac301d5d54a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:04.380314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.381063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.381346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.381619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.403523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:04.408386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:04.409388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:04.410255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 383/763] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:04.416619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.541809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:04.551174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e976b-f5b6-4c48-b25d-dffb0f3d6a93 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:04.588179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.589711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.590415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.591014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.591902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:04.592411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:04.594015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe186-ef43-44ca-8f24-e6086c035d08 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:04.603820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 381/764] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:04.609637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.663810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc10d4b-567b-4d7f-ae5d-eca5a26f74fc None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.664425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc10d4b-567b-4d7f-ae5d-eca5a26f74fc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.664932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc10d4b-567b-4d7f-ae5d-eca5a26f74fc None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.666698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 382/765] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:04.674363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.674943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.675433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.706339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:04.707938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:04.741823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f9a2-2149-4549-ac96-f911c4755368 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:04.753240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:04.779386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.780402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.780923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.781421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.793158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:04.794948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:04.810793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:04.811783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:04.812721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:04.812721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:04.812721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:04.814929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 384/766] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:04.820092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.850579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 383/767] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:04.909716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:04.940312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddedf1-1459-464d-945d-d8545e697dbb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:04.978947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:04.979978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:04.980463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:04.980973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:04.981855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:04.982552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:04.984137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:04.998306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 385/768] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:05.003845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.047396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.073094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.094276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7112fd-42fa-4987-84c1-56b7b398b0ce None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.133394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.134385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.134870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.135364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] PATH_INFO: `/v3/services/network` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.136727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.138590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:05.148992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:05.150004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:05.150845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:05.154520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 384/769] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:04 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:05.159938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.256419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0387d4e-a51d-40b2-905b-226085411958 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.290948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6a118-e873-4ab0-a26a-8909d0070945 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.311655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.312685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.313173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.314172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.324850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.326785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.329349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.330259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.330259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.330518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.331114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:05.331415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.332852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9aae1-de4d-475e-8963-c9d605fba14a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.337882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 385/770] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:05.339274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0432-9f89-45f1-9ecf-860bc1ebd97e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.339556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0432-9f89-45f1-9ecf-860bc1ebd97e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.339830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0432-9f89-45f1-9ecf-860bc1ebd97e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.341364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 386/771] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:05.342487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:05.343451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:05.344986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 386/772] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:05.347882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.348593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.349116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.351486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.371079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:05.372633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:05.387135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.467814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.469997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 387/773] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:05.471181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.499966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965249b5-ee3d-4c4e-92b8-ac8fb8ec47ad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.540226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.540887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.541171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.541445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.542961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:05.543269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.544971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.552877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 387/774] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:05.553917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.606406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c43d-5086-4d9a-8fb0-f337fe096ec8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.649833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.650888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.651373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.652401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.653845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:05.654391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.656764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.679310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 388/775] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:05.681154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.682648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4f2e-a056-41bf-9ddb-0b977ebd88ae None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.684781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.728294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.728965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.729248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.729524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.742431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:05.749752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:05.750781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:04:05.751650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:05.756289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 388/776] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:05.758343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.771421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.810507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913055f-252c-41aa-92d6-7d757ce18afa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.846785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.847401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.847683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.847977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.849454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] RBAC: Adding query filter params (interface=public, service_id=63553b81dcfc4b0e96d3a4c3d511bdb4, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:05.849771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.851446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.858192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 389/777] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/endpoints?service_id=63553b81dcfc4b0e96d3a4c3d511bdb4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:05.859013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.889033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f25274-24ce-4f85-b2b3-cf12d877b4cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:05.927199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:05.928204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:05.928739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:05.929261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:05.940347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:05.942666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:05.944370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:05.961509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:05.962491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:05.963396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:05.963396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:05.963396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:05.966061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 389/778] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:05.967215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:05.979529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401a12-55ba-4465-be15-a38962199b70 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.015608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.016231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.016510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.016830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.017644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:06.017854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.019280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.032769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 390/779] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:06.033652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.035085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.082352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dbd16-4ab4-4d66-bc3c-1a7bd0bbcdd0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.121282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.122245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.122733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.123259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.124090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.125783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.132006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 390/780] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:05 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:06.133166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.149379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c28a7-3510-4ca1-96e6-314d83bee285 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.181142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.191365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.192058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.192344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.192620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.193322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:06.193627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.195722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f838-9667-4fc9-b748-98e1c2c7d75d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.210723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 391/781] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:06.212308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2c6c-2ff6-49d8-ad71-80b78a3f0ed5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.212657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2c6c-2ff6-49d8-ad71-80b78a3f0ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.212940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2c6c-2ff6-49d8-ad71-80b78a3f0ed5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.214671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 392/782] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:06.216474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c2c6c-2ff6-49d8-ad71-80b78a3f0ed5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.260810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593495c-80d5-4b5e-b86a-df2268816d0f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.289020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.303661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.304668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.305131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.305630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.318782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.320684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.336481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c2c6c-2ff6-49d8-ad71-80b78a3f0ed5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ee8cb28a-2876-4eb5-815d-5824fd365f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:06.337873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:06.338819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:06.339840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:06.339840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:06.339840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:06.341853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 391/783] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:06.343260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.343691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.344110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.365130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:06.366572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:06.377272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.378241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.378550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.378923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.387456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.388953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:06.401895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:06.402944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:06.403865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 393/784] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:06.405067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.457676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 392/785] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:06.458873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.463393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.528398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7257-6841-4c0e-af03-ee71ae16542f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.565421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.566036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.566309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.566573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.567231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:06.567509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.568928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.579653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4c57-8c79-49c2-ad69-ee0bc6d65640 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.582369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.587247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 394/786] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:06.588002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.619409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.620928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.621425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.621983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.622867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:06.623353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.624994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.637988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 393/787] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:06.639135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.698780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d1bfb-9837-4dfa-b5fd-0b0486ff2f99 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.708731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.736755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.737386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.737665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.737928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.748718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4c9f-ac25-41fc-8ccf-3e53dbcd1a7a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.749471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:06.754179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:06.755104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:06.755958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 395/788] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:06.756657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.792520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.793641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.793641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.793842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.801790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.803207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0f801ab3-3d2b-459b-a187-fa7c442bb776 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:06.815562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:06.816523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 394/789] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:06.817893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74333-8c34-48a3-b81b-79db67fa3ca5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.818558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74333-8c34-48a3-b81b-79db67fa3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.818558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b74333-8c34-48a3-b81b-79db67fa3ca5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.824399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 395/790] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:06.824911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b74333-8c34-48a3-b81b-79db67fa3ca5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.851465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.865289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646db02-93a6-4ee8-ac10-8137f8b66c11 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.902367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.903004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.903278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.903545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.905492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=dbdc6b9326be4f509f1c085d13187bc4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.906915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:06.920511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 396/791] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:06 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:06.921396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:06.950821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b74333-8c34-48a3-b81b-79db67fa3ca5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:06.960976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:06.993874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:06.994587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:06.994866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:06.995701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:06.996844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:06.997255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:06.998696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef9cc6-c905-42c4-b468-e24653a20471 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.009013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 396/792] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.010381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.010662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.011501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.031226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:07.032463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:07.062527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd39f0-d182-4106-ba2a-b9f8ffc71af6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.109861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.110996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.111901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.112608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.113778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:07.114290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.116519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.118953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 397/793] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:07.120985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.141120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 397/794] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.142632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.146818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.246775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.254470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc771-61b9-4c35-87dd-81d261c0daee None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.264743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a385e-1241-46cf-9111-610ecc961099 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.297224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.298421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.298839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.299276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.310281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.312024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.315515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.316266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.316671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.317050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.329241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:07.329623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:07.330732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:07.331817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:07.331817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:07.331817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:07.333066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.333790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 398/795] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:07.334704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:07.355539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:07.356570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:07.357652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:07.357652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:07.357652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:07.359735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 398/796] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:07.360841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.437037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.460850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9c15-0661-4996-997a-232e3f1ccbc9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.466752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a315a-a3ed-4c60-9943-9e9c0abfef93 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.500304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.501023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.501410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.501848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.502600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.504181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.505026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.505747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.506209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.506570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.507309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:07.507805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.509285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:07.517247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:07.518292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:04:07.519131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:07.519878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.524939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 399/798] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:07.525825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.527842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 399/798] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.528858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.635527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a361-9403-4547-b65c-6c79dc9d8d4a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.636742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eceb45-8958-4b96-b2a3-4966f2905dfc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.668477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.674540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.675511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.676109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.676383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.677218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:07.677581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.677693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.678451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.678947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.679095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.679482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.680243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:07.680780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.682406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.688266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 400/799] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.689289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.701085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 400/800] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.701085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.763295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.807728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f970b2-e3d8-4136-bd90-1cde711bfe52 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.812161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9468d-3c93-40cc-8a60-634e74090312 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.849628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.850241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.850529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.850882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.851447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:07.851576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:07.851872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.852483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:07.852919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:07.853324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:07.853434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.862447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:07.864102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:07.864228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 401/801] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:07.865246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:07.876787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:07.877919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:07.878947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:07.881006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 401/802] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:07.887446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:07.928167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:07.976672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e308d-46ac-4ecf-ac61-2c409fc99436 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:07.998375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a160-5782-439e-9251-ff8c4815be9a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.014301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.014603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.014889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.015162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.022626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.024109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.024940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.037193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.038013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.038433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:08.038547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:08.039558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:08.040668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:08.041422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.042766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.044743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.045011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 402/803] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:08.045895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.074158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 402/804] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:08.075382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.206239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522202d-3aff-4331-a6d2-aa9ff35d56ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.237385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51110d-fe4d-42af-8ef5-f64d81d234a4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.250052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.251513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.253909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.254356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.255221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:08.255806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.259405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.275147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.288526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 403/805] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:08.293947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.307260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518141f9-428c-409a-9b78-165f14737390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.309923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141f9-428c-409a-9b78-165f14737390 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.310370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141f9-428c-409a-9b78-165f14737390 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.311202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141f9-428c-409a-9b78-165f14737390 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.312496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518141f9-428c-409a-9b78-165f14737390 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:08.312977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518141f9-428c-409a-9b78-165f14737390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.315289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518141f9-428c-409a-9b78-165f14737390 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.337084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.341932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 403/806] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:08.350586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38f10-79a0-464a-b7c9-38949ce2aa70 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.351146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38f10-79a0-464a-b7c9-38949ce2aa70 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.352030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38f10-79a0-464a-b7c9-38949ce2aa70 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.354440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 404/807] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:08.355841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b38f10-79a0-464a-b7c9-38949ce2aa70 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.420932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a8eb-4090-4406-94be-220b2ec69108 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.466769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.467749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.468230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.469203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/85122d5f39df41b08d41c51ae931b3ca/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.490566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=85122d5f39df41b08d41c51ae931b3ca, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.492964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31080c1d-b2f2-40d6-86a7-22bb82f3302d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.497226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b38f10-79a0-464a-b7c9-38949ce2aa70 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.511927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 404/808] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:08 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/85122d5f39df41b08d41c51ae931b3ca/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:04:08.513951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.514411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.515030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.538822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.539524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.539904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.540273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.542823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:08.544823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:08.552414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.554068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:08.571229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:08.572478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:08.574186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:08.574186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:08.574186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:08.575853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 405/809] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:08.586722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.647037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 405/810] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:08.664626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.703315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.731934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.763862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3078-f421-4fc8-90c1-a96b4c5e6a71 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.807443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.809516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.810013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.810741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.811813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:08.812320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.814499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.836600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 406/811] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:08.843288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.868786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613eb42-60f2-444e-9c51-54816f9a91ab None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:08.911962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:08.912687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:08.912973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:08.913241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] PATH_INFO: `/v3/services/network` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:08.913832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:08.915214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:08.928595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:08.929649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:04:08.930491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:08.937115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 406/812] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:08.941383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:08.942698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:08.967242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0966b-8e1b-4f93-bba7-59c3fca17cba None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.030992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.031510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.032538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.032881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.033153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.046763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.048214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.057145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd17db9-dc43-4ffc-bb8e-cf1b6574a089 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:09.067069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:09.067985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:09.068931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:09.077089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 407/813] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:09.082940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.098108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.099090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.099706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.099985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.100619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:09.100964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.102355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121f36-5c53-437f-a6be-1197c729d02b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.107364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 407/814] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:09.108671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f16c6-3a47-4990-b734-a9518173d857 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.108965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f16c6-3a47-4990-b734-a9518173d857 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.109237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f16c6-3a47-4990-b734-a9518173d857 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.110572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 408/815] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:09.114619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f16c6-3a47-4990-b734-a9518173d857 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.231490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5607d-aa1d-405e-bb01-487cc61d4f90 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.244186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f16c6-3a47-4990-b734-a9518173d857 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.267206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.267908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.268318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.268981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.269442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:09.269841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.271351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc85000-ad11-48c6-9044-59cf2b408b89 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.284435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.286870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 408/816] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:09.287711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.287840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.288208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.288477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.288586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.289053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.289898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] RBAC: Adding query filter params (type=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:09.290365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.292834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.299470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 409/817] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:09.300546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.303511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.311296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.311555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:09.312897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:09.410295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 409/818] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:09.410295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.442820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674f40-2dc6-4d35-ac8b-167c8b0c1619 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.479235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.480437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.480968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.481445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/30ea9dc686de47a3a860483a746025ca/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.483826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=30ea9dc686de47a3a860483a746025ca, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.485803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.504960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 410/819] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:09 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/30ea9dc686de47a3a860483a746025ca/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:09.506414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.594486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.594900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64595b-bb5c-42d5-8eaf-f3afd8fd2b59 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.639250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b91b-306b-45db-94ab-857e91d29433 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.678594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.679612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.680142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.680622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.694651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:09.701639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:09.702611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:09.703453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:09.705952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 411/820] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:09.708665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.708665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.708665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.708665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.709028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.710094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.712550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:09.717690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.743190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 410/821] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:09.846082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e478e4-1c66-490a-8152-8368452f047d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:09.876767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:09.893370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:09.894166 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:09.894540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:09.894925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:09.895696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:09.896090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:09.897644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:09.909508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 412/822] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:09.918389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.049270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4102486-7a2b-45cd-a035-a20ac14a22bc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.089306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.090444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.090822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.091193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.102773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.104360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:10.119737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:10.121668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:10.122750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:10.122750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:10.122750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:10.127947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 411/823] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:10.129301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.240620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e1ab-ce50-4cec-8b78-f0bc725bfcd3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.276940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.277742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.278121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.278492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.279257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:10.279658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.281152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.293777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 413/824] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:10.299704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.348979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:10.406168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f818-7b31-4f83-8f82-34170f2a26ba None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.442677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.443320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.443601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.443876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.451931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.453400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6eb81ee2-39eb-4755-98ed-8aaf5a4c5d9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:10.465231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:10.466188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:10.467168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 412/825] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:10.473972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.529083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:10.541631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ac4f-ac76-40e6-9b1a-2983da32bae2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.542263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ac4f-ac76-40e6-9b1a-2983da32bae2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.542729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ac4f-ac76-40e6-9b1a-2983da32bae2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.544733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 413/826] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:10.550004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.550517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.551000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.570552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:10.572157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:10.584789 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb0a0-e00f-413a-a8a1-58b365d654f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.623994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.624999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.625484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.625939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.626781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:10.627145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.628715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.651048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 414/827] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:10.655046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 414/828] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:10.655958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.678280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.720211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:10.775738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2a8e2-7039-469d-bcd1-38b1933127be None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.778067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:10.791376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91791fd7-df14-4501-9b35-9dfccbf70895 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.819713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.820736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.821233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.821694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.828638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.829297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.829577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.829850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.830435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.831799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:10.842153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:10.843349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:10.844381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 415/829] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:10.848940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:10.905347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.906969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f823-f50a-49cd-8508-fe58388bb205 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:10.956884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac6ad-26db-4a51-b1c2-0a87387d9292 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:10.965079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:10.994964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:10.996218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:10.996496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:10.996794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:10.997528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:10.997833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:10.999287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.004293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 416/830] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:11.009592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.025491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 415/831] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:11.027473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60e2a-866f-4342-879f-eaa5d50a77ac None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.027968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60e2a-866f-4342-879f-eaa5d50a77ac None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.028545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60e2a-866f-4342-879f-eaa5d50a77ac None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.030250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 416/832] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:11.031136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c60e2a-866f-4342-879f-eaa5d50a77ac None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.035613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.119599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0abcb-3ce4-4eea-b46c-4860a01250a1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.141901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c60e2a-866f-4342-879f-eaa5d50a77ac None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.160239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.161013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.161508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.161881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.162620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:11.163031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.164731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b58e-c9b6-4684-a1fd-207887bddbcd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.170439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 417/833] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:11.171707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.172049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.172381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.189139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.190050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.190477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.190997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.192699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:11.194147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:11.206067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.208688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.219668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:11.235882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:11.237269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:11.238400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:11.238400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:11.238400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:11.245163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 417/834] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:11.247467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.290945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 418/835] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:11.315060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.326583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.380031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0bcd-70b5-41df-9258-4ef6b853a575 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.427907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.427907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.427907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.427907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.428336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:11.428336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.429305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.443081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453f6dd-a828-4e4c-bd83-8875d95a2ae2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.445713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 418/836] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:11.451960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.489203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.489707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.489991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.490261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.507122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:11.516871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:11.517832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:04:11.518698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:11.521565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 419/837] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:11.527695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.551391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.575114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9259-1f87-41bc-a34d-a46054905c24 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.590910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.615278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.616230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.616814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.617297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.625843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.627696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:11.640203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:11.641129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:11.642038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:11.649036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 419/838] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:11.650537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.655634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe80f5e-3361-46fb-aeba-885415179b8b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.696684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.697322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.697604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.697876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.698571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:11.698872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.700244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.713554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 420/839] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:11.714528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.765732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89581a-6e3b-4976-955a-1154c2d6a5bb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.797004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.805556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.806490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.807006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.807492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.809179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:11.809703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.811349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442e84-0e6a-427e-a13c-ad6b58596d3e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.822129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473e19-3e35-450a-a6dc-9cc207818973 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.824976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 420/840] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:11.832602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09bed-a7ce-49ef-8fb8-58eae5675ed8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.832602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09bed-a7ce-49ef-8fb8-58eae5675ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.832602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09bed-a7ce-49ef-8fb8-58eae5675ed8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.832602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 421/841] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:11.832602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09bed-a7ce-49ef-8fb8-58eae5675ed8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:11.857823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.858450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.858725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.858993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.870222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.871656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.873195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-84775fb6-9d63-479d-94d1-7c774ae000de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:11.887967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:11.889003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:11.890010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:11.890010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:11.890010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:11.893850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 421/842] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:11.894888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.895174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.895448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.915825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:11.917200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:11.946289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09bed-a7ce-49ef-8fb8-58eae5675ed8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:11.981934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:11.982642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:11.982922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:11.983191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:11.983912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:11.984217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:11.985677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:11.992685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 422/843] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:11.992685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.002246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 422/844] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:12.026882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.095090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.128180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd50f5-bb0c-49ca-8197-52aa02e687b9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.137233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.156002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d87aa-a312-4094-a7b8-758b453ab6a5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.171878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.172497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.172888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.173157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.177030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:12.177030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.177030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.191950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 423/845] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:12.198113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.207378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.208784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.209252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.209694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.224540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:12.229505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:12.231137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:12.232063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 423/846] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:12.237874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.324213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e240fe-df08-40e7-900b-ffd44e4d520f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.346414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adb084-145d-48c8-99a5-18ac14649d18 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.369133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.370773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.371163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.371440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.373488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.382217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.384136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.398146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:12.398969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:12.400099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:12.401945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:12.402663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.403089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.403481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.404328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:12.404797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.404983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 424/847] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:12.406538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.406860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.423587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 424/848] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:12.427692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.457076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.534870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6977-406e-4b56-9aa0-fed6f9756391 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.535359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9e03-843d-4e45-959c-1b6b94bca1b6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.570764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.571773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.572127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.572546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.572777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.573623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.573902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.574415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.574624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:12.574959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.576388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.586941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.588724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.600220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 425/849] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:12.601794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:12.610839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:12.611807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:12.612728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:12.612728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:12.612728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:12.618814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 425/850] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:12.621547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.668003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.685001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.708400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9824b8-e536-431e-b046-87ff39dcb9e8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.744223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.745015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.745348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.745704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.759815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2391ee3-bca0-408c-b7c0-56c93fc0b28a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:12.805597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:12.806633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:12.807378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:12.808218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:12.809099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:12.809807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.812005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.817050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:12.818597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:12.832715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 426/851] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:12.834226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.915396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.947221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 426/852] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:12.952581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:12.954646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:12.965200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fe5f6-becc-4cc7-a8b2-2d3b336bd615 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.011725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.013153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.013910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.014385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.024122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.026096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:13.044268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:13.045372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:04:13.046571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:13.048606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 427/853] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:13.054435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.063532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2e40-2635-4f7c-bb59-439dfe54990d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.102273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.102910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.103184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.103509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.115271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.116756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:13.132314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:13.133369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:13.134284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:13.134284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:13.134284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:13.138636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 427/854] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:13.139930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.169136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d651-6f3c-45d6-b55b-414a457f4756 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.172134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.209030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.210109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.210670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.211137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.212073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:13.212832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.215295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.239867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 428/855] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:13.241118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.256718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.264748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30a12-7512-492e-b879-e99820d07cce None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.312209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.313096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.313373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.313637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.314899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:13.315364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.317120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ade54-1339-4def-82e2-e270dd77f7af None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.333036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 428/856] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:13.336743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d873-cce4-489c-a86a-3dc89b1e3235 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.336743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d873-cce4-489c-a86a-3dc89b1e3235 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.336743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d873-cce4-489c-a86a-3dc89b1e3235 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.336743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 429/857] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:13.338455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9d873-cce4-489c-a86a-3dc89b1e3235 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.352776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af5f-6618-439a-b053-9b4200e7b5c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.387910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.388514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.388810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.389078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.437664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.452328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9d873-cce4-489c-a86a-3dc89b1e3235 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.472214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.473678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.489022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.489444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.490397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.490934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.490934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.498582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.500021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fbfbbe1e-d05e-408f-9e73-a7b2cb4ace51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:13.511482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:13.512457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:13.513522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:13.517443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 430/858] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:13.518677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.518965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.519240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.537626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:13.538857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:13.584371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 429/859] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:13.585264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.613052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 431/860] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:13.613799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.696379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.708725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5aa1-771c-4cfa-a106-a0ed5929dafc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.719174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63639c28-11d7-44a1-a28a-36106833d316 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.724443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.748962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.749681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.749956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.750228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.750911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:13.751216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.752624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.754437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.755073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.755351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.755623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.765607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 430/861] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:13.766029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.766806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.767484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:13.786185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:13.787244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:13.788149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:13.788149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:13.788149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:13.788149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 432/862] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:13.788149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.886279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391cb7c-78aa-4e68-a5da-1fb4d8b1ce73 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.898807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b649f-1917-4e65-a349-8a156ce549d4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:13.922486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.923244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.923524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.923797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.924440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.925873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718692-f5d4-46ac-ab8a-03c2631fb079 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.930505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:13.937778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:13.938381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:13.938684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:13.938925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:13.939642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=85122d5f39df41b08d41c51ae931b3ca) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:13.939948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:13.941401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:13.953096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 433/863] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/role_assignments?user.id=85122d5f39df41b08d41c51ae931b3ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:13.953096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:13.953356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 431/864] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:13 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:14.092459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d11f-0239-4d9b-a2ad-7fadb4285362 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.141244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.141861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.142134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.142393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.143085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:14.143404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.143759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f34a-925f-4c8a-ba61-1756d6170d08 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.144147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f34a-925f-4c8a-ba61-1756d6170d08 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.144569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f34a-925f-4c8a-ba61-1756d6170d08 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.144777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.145990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 432/865] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:14.152118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.152464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.152854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.158910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 434/866] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:14.164305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.177601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:14.178819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:14.210443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:14.224561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:14.276333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 433/867] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:14.292513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d16f-8eb7-4511-a294-acf7ff01621a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.297502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.338052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.338722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.339004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.339279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.349032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.351139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:14.366173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:14.367138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:14.368265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 435/868] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:14.374021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.413842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee737123-e633-4dc5-a961-17ca55afbf89 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.462730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.463360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.463713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.463986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.465269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.466644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:14.478899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:14.479989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:14.480945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 434/869] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:14.486330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.499613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303140-c67e-4996-bfb0-539f05e77182 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.511236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:14.540548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.540991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:14.541703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.542205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.542627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.544014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:14.544480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.546577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.563809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 436/870] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:14.569562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.605935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c3070-0602-461b-ad42-628c4aa5b57c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.644608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.645396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.645769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.646136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.646884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:14.647320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.648964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.658925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 435/871] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:14.660266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:14.701133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3cb2-38e3-4e62-b20c-61132cf0f203 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.737478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.738373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.738795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.739225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.740038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=30ea9dc686de47a3a860483a746025ca) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:14.740441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.742109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c922-4915-4771-93e0-9be6d3e078dd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.749314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 437/872] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/role_assignments?user.id=30ea9dc686de47a3a860483a746025ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:14.789153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:14.793826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facc11-643e-4f7a-b1a1-11ea39370814 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:14.834182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:14.834819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:14.835096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:14.835365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:14.836018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:14.836321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:14.837768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cff43-72f1-4179-a405-5d1b96e80dba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:14.848829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 436/873] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:16.086109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174389f-c8a0-4d3c-8489-1393ab7a9a8c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.087120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174389f-c8a0-4d3c-8489-1393ab7a9a8c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.087619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174389f-c8a0-4d3c-8489-1393ab7a9a8c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.090017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 438/874] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:16.095398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.096228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.096767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.116134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:16.117655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:16.147000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb31f-8bc0-4f53-a516-8de64d059ce5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.147307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb31f-8bc0-4f53-a516-8de64d059ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.147545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb31f-8bc0-4f53-a516-8de64d059ce5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.149152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 439/875] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:16.154404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.154688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.154964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.173700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:16.174890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:16.194928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 437/876] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:16.205020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.218162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.251363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 440/877] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:16.279430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.316343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.333263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf301-df35-44f7-9531-a87798a7a71d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.369570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.371124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.371604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.372074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.372884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.374436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:16.383673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:16.384699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:16.385607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:16.388281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 438/878] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:16.388475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989dac6-62fc-4483-abab-9e008c9c2959 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.394903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.445266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.446140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.446585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.447016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.458124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:16.463019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:16.464541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:16.465453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:16.472742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 441/879] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:16.473841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.521066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.529357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab50d1-17f5-4c9a-b970-7c9a8e55d17c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.575713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.576351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.576632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.576934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.577574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:16.577907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.580244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.582157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deedeb-6530-4659-b3cf-d70b2f412730 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.591584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 439/880] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:16.593256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.615189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.630446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.631606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.632366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.633309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.634470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:16.634997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.637863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.649736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 442/881] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:16.655425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.716677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebba173-d5db-4303-b01d-57e79ce8d7af None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.754547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.755394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.755938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.756412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.757321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:16.757854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.759411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.770480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 440/882] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:16.771637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.773907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.795535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3defd-c698-4955-b560-d3f8679a126a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.837812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.838466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.839439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.839864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.851246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.852782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.863613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-03f6cf42-4ccd-4548-9f59-fec905496eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:16.867592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:16.868680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 443/883] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964619-c830-42b7-bae8-9f17e74f87b6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964619-c830-42b7-bae8-9f17e74f87b6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964619-c830-42b7-bae8-9f17e74f87b6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 444/884] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:16.875705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964619-c830-42b7-bae8-9f17e74f87b6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:16.897321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb11e-3ca9-491a-8fed-76d861d426ba None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:16.933941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:16.934566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.934813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.935079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.935770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] RBAC: Adding query filter params (interface=public, service_id=57c2ad5882554fd48550223a94bc7085, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:16.936070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:16.937445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718387-15ca-4a83-8a26-47b66e2c9f28 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:16.949766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 441/885] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/endpoints?service_id=57c2ad5882554fd48550223a94bc7085&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:16.949766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:16.949766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:16.949766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:16.965689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:16.966862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:16.987519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964619-c830-42b7-bae8-9f17e74f87b6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.022106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.022703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.022975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.023240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.023876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:17.024173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.025567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151313-12e5-4cc9-b517-b97bf5e29f53 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.032730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.033991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 442/886] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:17.034896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.037964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 445/887] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:17.039387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a926-8917-481a-a486-4ab0369b95c9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.039672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a926-8917-481a-a486-4ab0369b95c9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.039940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a926-8917-481a-a486-4ab0369b95c9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.041314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 446/888] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:17.045484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536a926-8917-481a-a486-4ab0369b95c9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.109801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.140870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04e44-f580-4771-9e42-78d807c792ac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.148730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536a926-8917-481a-a486-4ab0369b95c9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.175697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.176323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.176597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.176895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.177500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.178882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8879990-d54e-4ecd-a791-f55d312b8133 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.183108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.183892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.184160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.184427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.184802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 443/889] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/services => generated 1011 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:04:17.186017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.186299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.186570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.197328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.199534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:17.212433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:17.214268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:17.215556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:17.216198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:17.216198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:17.217696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 447/890] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:17.223544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.289821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.301038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 444/891] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:17.302002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.346551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b39527-1a76-4c56-a438-4660df762434 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.379711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.387712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.388512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.388817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.389087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.390457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.391837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:17.402617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:17.403768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:17.405066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 448/892] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:17.409200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.427598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4375bad-b853-49c0-a295-6874160dc39a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.465720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.466677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.467189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.467667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.468561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:17.469117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.470828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.489702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 445/893] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:17.490614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.521641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d107-0e98-4a6e-a203-fab0120a566d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.545983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.560114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.560749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.561059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.561302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.561945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.563334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.588688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 449/894] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:17 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:17.588688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.615948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d45e6-8205-4ff0-9a43-1eb4d369c965 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.642892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.664017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.664670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.665033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.665364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.666136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:17.666479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.668123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.674044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 446/895] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:17.681753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:17.728823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135c99-e84a-4b6c-8029-b24ddd1ef8f7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.780073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.780856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.781111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.781376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.817322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828e85-d932-450a-a8c6-fd59b0a0a783 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:17.845035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:17.859009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:17.859955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:17.860507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:17.861056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:17.861882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:17.862396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.864808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.867959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:17.869876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:17.870938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 447/896] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:17.988621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 450/897] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:17.994493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:18.046791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:18.103968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360946b5-a2c4-4784-bbfd-fe06a7f62652 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:18.139866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:18.140484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:18.140787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:18.141059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:18.151721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:18.153201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:18.168381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:18.169488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:18.170380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:18.170380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:18.170380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:18.170380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 448/898] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:18.175353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:18.266399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:18.286085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dbd1d-a848-4109-aed5-9430c73d6971 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:18.321850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:18.322458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:18.322734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:18.323566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:18.324215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:18.324516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:18.325924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:18.339047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 451/899] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:18.344752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:18.454049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:18.458194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644712e-d14a-4c4c-991b-01bcacbe5f07 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:18.493576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:18.494514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:18.495685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:18.496186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:18.503373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:18.505025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:18.516915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:18.518548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:18.520337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:18.528839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 449/900] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:18.531335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:18.633990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dfe2-9aec-47da-a478-1748e35425f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:18.668954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:18.669925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:18.670374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:18.670812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:18.671733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:18.672208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:18.673858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa699bc1-cad1-4f8a-84b1-cba5dcf78cd5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:18.687394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 452/901] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:18.693788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:18.798973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d4f19-6c39-44c0-a452-da0549a214d4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:18.836320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:18.837314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:18.837766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:18.838209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:18.839906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] RBAC: Adding query filter params (role.id=d753ec2b89f24da7b5f65c4e02ba90aa, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=85122d5f39df41b08d41c51ae931b3ca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:18.840417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:18.842090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9107213-3dbc-43b0-8672-2e16d9d70d0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:18.853053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 450/902] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:18 2022] GET /identity/v3/role_assignments?user.id=85122d5f39df41b08d41c51ae931b3ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=d753ec2b89f24da7b5f65c4e02ba90aa => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:19.296303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d47f0-06ca-4ed2-a3c5-d1a5d11d637a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.296882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d47f0-06ca-4ed2-a3c5-d1a5d11d637a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.296882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d47f0-06ca-4ed2-a3c5-d1a5d11d637a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.298561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 453/903] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:19.303852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.304264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.304408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.324048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:19.325251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:19.342823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:19.402467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 451/904] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:19.425757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d47f0-06ca-4ed2-a3c5-d1a5d11d637a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:19.428880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:19.535796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d47f0-06ca-4ed2-a3c5-d1a5d11d637a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:19.571033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:19.571626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.571902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.572165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.572815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:19.574517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:19.583625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:19.584637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:19.585902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 454/905] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:19.594473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:19.702194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15a769-bc04-4436-a4bb-7f4d5cfb0768 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:19.741986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:19.742606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.742884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.743188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.743796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:19.744101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:19.746026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f170f7-9741-4ad2-8a7f-556ee13bcf76 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:19.751139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 452/906] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:19.756875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:19.773842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9330-fc38-48e8-bd1d-ae6f3a3f5fd2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.774127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9330-fc38-48e8-bd1d-ae6f3a3f5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.774394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9330-fc38-48e8-bd1d-ae6f3a3f5fd2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.776517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 453/907] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:19.781401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.781685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.781955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.801308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:19.802498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:19.829060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:19.836167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:19.879144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 454/908] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:19.888229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295fdb-b95e-4320-93bf-f87af99db222 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:19.905110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:19.936571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:19.937469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:19.937757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:19.938031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:19.938664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:19.938966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:19.940507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:19.952085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 455/909] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:19.953666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.020009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea9f6d-1536-4bc8-a0eb-33845097af52 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.060139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.061191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.061384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.061688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.062238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.063607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.066400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ddce-5a00-4d34-9896-864bc3a1f598 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4fe5bc89-0062-44a7-89af-0456724c37d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:20.072578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:20.074325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:20.075229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:20.079566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 455/910] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Aug 8 02:04:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:20.080582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb96d55-c253-423b-b4dd-65b1c306de6d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.080898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb96d55-c253-423b-b4dd-65b1c306de6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.081263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb96d55-c253-423b-b4dd-65b1c306de6d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.087039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 456/911] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:20.087039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb96d55-c253-423b-b4dd-65b1c306de6d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.098274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:20.106064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:20.112597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.113239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.113516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.113834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.114490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.115908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588f6d-a413-48c6-aef0-c139048ba5bd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.136399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 456/912] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:20.137893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.138205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.138482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.158079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:20.159306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:20.227370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb96d55-c253-423b-b4dd-65b1c306de6d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.264675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 457/913] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:20.272769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.273432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.273708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.273979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.274719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:20.275019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.277443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.283127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 457/914] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:20.288502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.293720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.378128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:20.418520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee03e-0544-40ae-90af-6e31b4e2a0ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.423127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bfe17-8110-4ac1-ac6b-9e5efa28aec6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.450651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:20.459200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.460073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.460494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.461216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.461996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:20.462465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.464003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.470226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 458/915] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:20.475820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.476816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.477482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.477758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.478023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.478717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.480436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.504781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 458/916] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:20 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:20.594781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc784ef-5154-4172-bd36-a99f77eaa59e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.633961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:20.640808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.641755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.642212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.642489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.643256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] RBAC: Adding query filter params (interface=public, service_id=76f4cc3fa7e44a559640db2a6b1a83f7, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:20.643822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.645249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40627-036e-4559-b9fa-5d1782ffafce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.652098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 459/917] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:20 2022] GET /identity/v3/endpoints?service_id=76f4cc3fa7e44a559640db2a6b1a83f7&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:20.658535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:20.768448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc3f6-fd31-4d1f-9cf8-b2d71dd47078 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:20.804034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:20.804965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.805443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.805895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.806663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:20.809180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066efcb3-fc7d-4b03-8b40-e74bd1905391 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:20.815687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 459/918] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:20 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:04:20.974742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5510f2-0254-41ef-a6c5-629136a83bd4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.975035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5510f2-0254-41ef-a6c5-629136a83bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.975200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5510f2-0254-41ef-a6c5-629136a83bd4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:20.976683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 460/919] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:20.981841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:20.982127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:20.982401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.002167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:21.003608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:21.041489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:21.076834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 460/920] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:21.099498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5510f2-0254-41ef-a6c5-629136a83bd4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:21.208013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5510f2-0254-41ef-a6c5-629136a83bd4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:21.246441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:21.247344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:21.247812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:21.248253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.259615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:21.265437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:21.266381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:21.267207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:21.269553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 461/921] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:21.275552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:21.381079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cc12-ff8c-4700-a207-ebe210029fdc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:21.423825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:21.425132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:21.425641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:21.426051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.426858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:21.427296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:21.428837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:21.440450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 461/922] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:21.446449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:21.505120 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:21.551944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83815ba-84ca-4892-8a6b-b0fd9a7dbe7d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:21.587065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:21.587687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:21.587959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:21.588226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.599675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:21.601317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:21.616358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:21.617460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:21.618594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:21.618594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:21.618594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:21.618594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 462/923] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:21.624322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:21.656283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:21.730686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf266-dddf-42b4-8b2b-67edd610c718 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:21.767383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:21.767913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:21.768194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:21.768467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.769141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:21.769442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:21.770818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:21.783500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 462/924] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:21.790056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:21.895044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfdf9-d484-408c-bf0e-289ef65d34d9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:21.902329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:21.929575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:21.930206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:21.930475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:21.930739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:21.941648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:21.943087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:21.955416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:21.956569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:21.957900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 463/925] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:21.965734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.061006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.070330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccb587-e35d-413a-9b07-ce27642990d4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.107725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.108341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.108620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.108919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.109658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:22.110046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.111489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.130545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 463/926] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:22.136433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.239906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08280-8744-4d4e-b6d5-684879c7fcfb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.274610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.275232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.275504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.275951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.287410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.288884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ed204975-da05-4769-a4a9-5ccf97399fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:22.303293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:22.304259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:22.305213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:22.305213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:22.305213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.305213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 464/927] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:22.310558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.365893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf37-e5ba-4b6b-926c-549906daac30 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.366066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf37-e5ba-4b6b-926c-549906daac30 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.366344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf37-e5ba-4b6b-926c-549906daac30 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.368879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 465/928] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:22.373795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.374066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.374335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.393949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:22.395124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:22.412614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.426606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33c6a-9e3a-4e88-a45e-f2a87aecfbe2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.466615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.467269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.467676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.467999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.468680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:22.469259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.470623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.484959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 464/929] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:22.493359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 466/930] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:22.493843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.511664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.518528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.624067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd3dd-3406-4284-ba4b-03ccbd30ad3b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.631233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dba0d-e4b9-48e3-9f17-4f528bdb77ca None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.666322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.668085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.668361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.668629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.674312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.674918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.675236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.675508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.676141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.677721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.680461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING keystone.server.flask.common [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 02:04:22.682504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.684034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.698888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:04:22.698888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:04:22.698888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [parameters: {'id': '4c157fc0ac8a4b6e83c630443cff50dd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:04:22.698888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bdb38b9c-bf40-45fc-bce3-a437e24a107c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:22.699270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:22.700108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:22.701038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:22.705036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 465/931] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:22.706141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221e3d-e62f-4686-9564-fa181e4dab34 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.706418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221e3d-e62f-4686-9564-fa181e4dab34 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.706684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221e3d-e62f-4686-9564-fa181e4dab34 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.708092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 466/932] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:22.709045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221e3d-e62f-4686-9564-fa181e4dab34 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-561a6d44-6dc7-48a3-914e-55a53084efc9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c157fc0ac8a4b6e83c630443cff50dd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c157fc0ac8a4b6e83c630443cff50dd. Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:04:22.719008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 02:04:22.719882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Aug 08 02:04:22.720963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:04:22.721890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:04:22.722848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:04:22.723675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'id': '4c157fc0ac8a4b6e83c630443cff50dd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.726522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:22.728828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c157fc0ac8a4b6e83c630443cff50dd. Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 467/933] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Aug 8 02:04:22 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.732341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.734554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.735179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.750434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:22.751977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:22.796396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.829541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 468/934] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:22.830525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.840519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221e3d-e62f-4686-9564-fa181e4dab34 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.878545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.879376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.879793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.880220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.881089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:22.881529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.883104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:22.900235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 467/935] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:22.901059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:22.949659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c4ee-4542-48e0-a474-d790e65ea846 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:22.986034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:22.986660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.986935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.987206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.989229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:22.995950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:22.998076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:23.009360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:23.010466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:23.011553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:23.013998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b93bd-1fc3-4ada-a2b5-014eca465fcf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.016047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 469/936] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:23.017161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.044030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.050692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.051319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.051598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.051867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.052439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.053834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:23.063550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:23.064590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.065464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 468/937] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:23.066251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.125769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a83fcd-bced-4425-b010-6344ef618bac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.159777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.160361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.160635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.160933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/85122d5f39df41b08d41c51ae931b3ca/roles/d753ec2b89f24da7b5f65c4e02ba90aa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.163045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=85122d5f39df41b08d41c51ae931b3ca, role_id=d753ec2b89f24da7b5f65c4e02ba90aa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.164463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282f656-217e-4544-8c75-3180ed9dc3c9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.166361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511ca4-f1b5-4e63-9bcf-a5d2bfe9c0a9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.177722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 470/938] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:23 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/85122d5f39df41b08d41c51ae931b3ca/roles/d753ec2b89f24da7b5f65c4e02ba90aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:23.179074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae761-357c-4ed5-a161-5f70b7129548 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.179362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae761-357c-4ed5-a161-5f70b7129548 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.179640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae761-357c-4ed5-a161-5f70b7129548 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.187924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 471/939] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:23.187924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae761-357c-4ed5-a161-5f70b7129548 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.212162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.212833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.213111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.214035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.214730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.215031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.216511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3847d8-9e68-4076-a257-ea2bf79ab39e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.236190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 469/940] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:23.237516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.237805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.238069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.266630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:23.268043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:23.283228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.346896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.352257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae761-357c-4ed5-a161-5f70b7129548 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.367873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 470/941] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:23.391783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.397915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.398898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.399401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.399874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.400805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.402099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.404117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.410197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 472/942] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:23.416284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.532743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16d388-2015-42c9-9f48-d7bea7d74ff4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.535999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37d9-c6b1-4524-b35e-c811a8d627f3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.559099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.580256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.580941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.581276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.581560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.582244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.583921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.585437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.586517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.587343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.587766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.589085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.589543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.591127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:23.594806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:23.596002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:23.597134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 471/943] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:23.600430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 473/944] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:23.602011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.607331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.662170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.715459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9e9d-ddee-4acb-8f83-d6296055822f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.723126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b024-2203-4a5c-aa95-531489c0b2bb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.759661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.761295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.761723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.762147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.763011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] RBAC: Adding query filter params (interface=public, service_id=ca3a88d11fbe4ea09273f2f48f4effae, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.763466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.765098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.765690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.766414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.766793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.767162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.767906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.768355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.769901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.772921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 474/945] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/endpoints?service_id=ca3a88d11fbe4ea09273f2f48f4effae&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:23.779327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 472/946] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:23.780438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.784709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.840953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.904488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccbde-ace8-4a0e-975c-e3801839246e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.918275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6891e-cbd8-47ff-9ce2-127bfb6906a2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:23.919657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:23.950116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.951258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.951909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.952436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.953769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:23.954369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.955972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.962627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 473/947] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:23.965664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:23.966540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:23.967122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:23.967648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:23.968554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:23.969544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:23.970940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eead6-d984-4d89-a5c6-a22fa83f4821 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:23.984827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 475/948] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:23 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:04:24.090648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3344-76eb-4654-aac4-e69e9c528056 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:24.131876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:24.132989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:24.133486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:24.133975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:24.134847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:24.136480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f0079-e4ca-413a-8e40-0a560a752e92 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:24.159856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 474/949] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:25.297296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47d38-fa64-45e1-a363-e970bf6f7dd7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.297863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47d38-fa64-45e1-a363-e970bf6f7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.297949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47d38-fa64-45e1-a363-e970bf6f7dd7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.299651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 476/950] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:25.305716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.306690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.307224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.326787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:25.328310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:25.357173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:25.403725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992c6c-7c0d-40ae-ac3b-31d067642848 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.404013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992c6c-7c0d-40ae-ac3b-31d067642848 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.404289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992c6c-7c0d-40ae-ac3b-31d067642848 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.405751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 477/951] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:25.410809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 475/952] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:25.411034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.411530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.412020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.434019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:25.435473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:25.435593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.524712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 478/953] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:25.540992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.561126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923e931-6abe-455f-be89-e2cc2b516962 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:25.589235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:25.607414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:25.608558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.609097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.609565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.622392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:25.627698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:25.628937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:25.630152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:25.632848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 476/954] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:25.638914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.656217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53223276-e20f-473f-8de3-92429e4a0ca0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:25.662479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:25.692675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:25.693753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.694273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.694757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.695691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:25.697382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:25.715147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:04:25.715147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:04:25.715147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [parameters: {'user_id': '9b45d1c4d450409bbaebc94a89423f6c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:04:25.715147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Aug 08 02:04:25.723704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:04:25.724932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:04:25.726020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:04:25.727035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:04:25.727946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:04:25.728982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'user_id': '9b45d1c4d450409bbaebc94a89423f6c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:25.729855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 02:04:25.730783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:04:25.731770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.739921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 479/955] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Aug 8 02:04:25 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:25.741372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.753736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffe60-0e33-4340-b913-450fb0804114 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:25.792408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:25.793053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.793330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.793597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.794256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:25.794554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:25.795932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:25.810713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 477/956] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:25.811794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.857520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d632-81cd-4510-b359-dc4997c3fb20 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:25.859660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:25.896028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:25.897514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.898228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.898940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.906583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:25.908531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:25.910424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:25.923366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:25.924486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:04:25.925527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:25.933015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6dfab-255e-40a3-9bfc-3ecd1a6f479d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:25.933309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 480/957] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:25.934375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:25.965468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:25.966164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:25.966441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:25.966715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:25.978663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:25.981136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:25.997968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:25.998966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:25.999974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:25.999974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:25.999974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.004014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 478/958] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:26.004886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.044406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c936-e98a-4527-b33f-8f6b06703249 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.081526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.082157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.082443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.082717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.083419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.083722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.085716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735adc-ecd6-486c-9250-529d327d70aa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.115517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228bb7-9a31-4088-a6ee-0981ca6a5e93 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.130208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 481/959] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:26.132704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c1ae-d03c-4b9b-bd05-e4d1f9425343 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.132704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c1ae-d03c-4b9b-bd05-e4d1f9425343 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.132704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c1ae-d03c-4b9b-bd05-e4d1f9425343 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.133630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 482/960] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:26.142742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa3f-8a63-4fde-9e3e-b6a349c3e41d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.143176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa3f-8a63-4fde-9e3e-b6a349c3e41d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.143653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa3f-8a63-4fde-9e3e-b6a349c3e41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.152009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.158672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.159303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.159578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.159849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.160517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.160859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.162270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.169979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6675aa3f-8a63-4fde-9e3e-b6a349c3e41d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:26.172091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6675aa3f-8a63-4fde-9e3e-b6a349c3e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:26.181399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 479/961] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:26.182373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.190499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.276559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 483/962] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:26.278372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b4d7-b7e6-4715-b1a0-c366237fe3f6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.279075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b4d7-b7e6-4715-b1a0-c366237fe3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.279357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b4d7-b7e6-4715-b1a0-c366237fe3f6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.281736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 484/963] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:26.287542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.287896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.288247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.308692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078ac82-6872-4c2b-930e-3a5f28c400f8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.309232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:26.310126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:26.347279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.347879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.348121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.348395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.357031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.358491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:26.373128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:26.374153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.375126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 480/964] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:26.375748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.393413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 485/965] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:26.394190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.436016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.480990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.484016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aee8a-a9ec-4695-b0b8-18bb9d0b232e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.500864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832f590-72fc-4aee-a4c1-51897aad5a62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.524361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.525025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.525303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.525579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.526201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.527653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.535085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.535689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.535967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.536241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:26.536366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:26.537390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:26.538263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.539017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.539017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.539159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 481/966] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:26.539159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.539295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.559174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 486/967] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:26.560266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.643309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925aaf3-8b55-4c93-9fcf-3a56534385b6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.660008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.663884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f36951-9962-4205-9669-3056e6ada2e1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.677808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.678668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.678946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.679219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.679794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.681200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:26.689960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:26.691102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:26.692155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 482/968] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:26.693193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.701965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.702580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.702926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.703208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.703838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.704143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.705521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.716045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 487/969] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:26.716045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.716045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.792206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b589f-9b3a-4452-91d7-7a599b55e468 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.811613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0dff8-f005-47c0-bf5d-89300664fe86 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.826032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.826643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.826949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.827224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.846144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.846746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.847026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.847297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.847933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.848234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.849876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.855131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 488/970] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:26.855905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:26.876724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.896901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.898288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:26.920407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:26.955028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9ad4-6de3-42e4-95c6-5cfb87304993 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:26.988571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:26.989213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:26.989493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:26.989764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:26.990394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:26.990693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:26.992038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.001747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 489/972] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:27.001900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 483/972] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:27.001998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.002946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.082381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:27.098615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958f65-b90f-48f8-9231-e06ceb9268ad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.102881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871eaba-bb2b-44a7-ab29-3ced08aa7e83 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.131196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:27.137432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.138047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.138317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.138429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.138597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.139004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.139284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.139559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.140187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:27.140493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.141896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.146253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 490/973] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:27.147063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.148988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.150465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:27.166523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:27.167813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:27.169255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:27.169255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:27.169255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:27.172483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 484/974] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:27.173568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.281947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c638-fedc-4107-bc68-3af56402de90 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.282550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59aaad-ccc5-4a11-8e13-13e7d8b2f072 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.324862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:27.327388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.328065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.328353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.328627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.329317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.330678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.331435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.332043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.332318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.332586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.333281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:27.333580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.334933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.349486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 485/975] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:27.354717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 491/976] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:27.357961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.483782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29dc2e-1eb7-426d-8f7b-9910ef26d49d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.529548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.530456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.530893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.531163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.538719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.540162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:27.551927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:27.552965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:27.553892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 486/977] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:27.559639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.616283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:27.670484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb0d9e-d05a-4c80-aaeb-868798db5d98 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.705100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.705744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.706022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.706289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.707371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:27.707677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.709127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf67d71-303d-40cf-b50a-6af9713874e0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.727098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 492/978] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:27.728319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:27.779230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:27.831766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba355c5a-5d39-4108-85df-54f22a83eec3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:27.867401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:27.868003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:27.868275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:27.868538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:27.869279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] RBAC: Adding query filter params (role.id=d753ec2b89f24da7b5f65c4e02ba90aa, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=85122d5f39df41b08d41c51ae931b3ca) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:27.869663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:27.871415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f49867-df8b-408c-8aa7-8052bb0f46b8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:27.884908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 487/979] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:27 2022] GET /identity/v3/role_assignments?user.id=85122d5f39df41b08d41c51ae931b3ca&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=d753ec2b89f24da7b5f65c4e02ba90aa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:29.170039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a02b44-b379-46db-9399-3d00e32de73f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.170567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a02b44-b379-46db-9399-3d00e32de73f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.170567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a02b44-b379-46db-9399-3d00e32de73f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.172057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 493/980] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:29.177124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9271-85dc-4174-a9b5-12da64829786 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.177542 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9271-85dc-4174-a9b5-12da64829786 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.177703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9271-85dc-4174-a9b5-12da64829786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.195546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5b9d9271-85dc-4174-a9b5-12da64829786 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:29.196835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b9d9271-85dc-4174-a9b5-12da64829786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:29.268692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 488/981] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:29.289260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a02b44-b379-46db-9399-3d00e32de73f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:29.393307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a02b44-b379-46db-9399-3d00e32de73f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:29.398453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cda7-c2fa-43ae-bf17-5276906d2bc9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.398738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cda7-c2fa-43ae-bf17-5276906d2bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.399015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cda7-c2fa-43ae-bf17-5276906d2bc9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.400561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 489/982] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:29.404592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:29.405479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.405659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.405938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.427372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:29.427372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:29.431427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:29.432280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.432558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.433171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.433828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:29.435190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:29.454261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 494/983] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:29 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:29.467107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:29.512256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 490/984] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:29.534638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:29.649066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167dad7-e6bf-4151-b536-760696d1764a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:29.683020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:29.683573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.683850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.684119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.684719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:29.686072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:29.694733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:29.695725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:29.696675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 495/985] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:29.704212 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:29.806417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca6c9-9d96-4991-a2c8-fea248b7e6af None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:29.840816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:29.841424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.841698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.841964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.842585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:29.842885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:29.844236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf79e46-37b2-4c73-b688-3ae294dac660 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:29.854413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 491/986] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:29.855860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:29.891789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:29.951259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cbe2-c9c1-4453-8b6e-a4e300a960ee None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.951547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cbe2-c9c1-4453-8b6e-a4e300a960ee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.951730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cbe2-c9c1-4453-8b6e-a4e300a960ee None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.954018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 492/987] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:29.958848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:29.959135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:29.959408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:29.963914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb5416-d348-49e8-90cd-a22eb27f6f1e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:29.979842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:29.981047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:30.000134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.000775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.001055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.001326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.002083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:30.002387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.003749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.007629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:30.015348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 496/988] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:30.016418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:30.052974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 493/989] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:30.074546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:30.131741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:30.136413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7dbaf-e8e3-4d34-abd8-91a04c7c8f2c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:30.175894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.176561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.176993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.177106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.177736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] RBAC: Adding query filter params (interface=admin, service_id=ca3a88d11fbe4ea09273f2f48f4effae, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:30.178036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.179375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.184732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 497/990] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Aug 8 02:04:30 2022] GET /identity/v3/endpoints?service_id=ca3a88d11fbe4ea09273f2f48f4effae&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:30.186990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5fec7-9a7d-4ee5-a222-176bb7041a1a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:30.190097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:30.225489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.226048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.226325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.226596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.227179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.229193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:30.238921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:30.239961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:30.240869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 494/991] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Aug 8 02:04:30 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:30.245954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:30.274351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:30.303297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa50a-3739-4f0d-b09b-7c647dbfa930 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:30.340547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.341180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.341553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.341727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.342333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.343688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.350169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 498/992] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:30 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:04:30.363614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3536ccd-84c2-407a-9030-c8ed6a3b03ee None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:30.402445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.403070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.403346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.403614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.404257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] RBAC: Adding query filter params (name=image) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:30.404558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.405999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311f75-0f97-4ead-ad34-9da6b5c28f4d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.411732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 495/993] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:30.418302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:30.450088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:30.531842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cfff-b82e-48ca-98b1-dd0e827434f2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:30.568084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:30.569139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:30.569642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:30.570115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:30.570938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:30.571435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:30.573511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1a32b-a994-41a1-8b66-b0c685dba23b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:30.578765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 499/994] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:31.518609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7116-7d50-4af5-b196-272205c5c599 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.519122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7116-7d50-4af5-b196-272205c5c599 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.519122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7116-7d50-4af5-b196-272205c5c599 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.520602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 496/995] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:31.526164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.526573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.526792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.544876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:31.546054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:31.614828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 500/996] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:31.637223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa7116-7d50-4af5-b196-272205c5c599 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:31.733292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:31.745185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa7116-7d50-4af5-b196-272205c5c599 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:31.779606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:31.780231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.780502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.780792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.781361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:31.782713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:31.791751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:31.792769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:31.793640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:31.796959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 497/997] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:31.798878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:31.820214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:31.900367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238faed0-ac0d-4fbb-b77f-c135b47207a2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:31.934091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:31.934688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.934963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.935228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.935841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:31.936136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:31.937506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:31.946951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 501/998] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:31.948736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.048776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ae0b-487d-4791-bbae-4836ac47c874 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.082177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.082782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.083052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.083317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.083935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:32.084230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.085608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.097365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 498/999] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:32.097558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.185493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:32.202692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce929edd-df31-47a4-8c59-5350f53d62ca None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.237276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.237883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.238162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.238454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.239123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] RBAC: Adding query filter params (interface=public, service_id=eec06f7570b74c119719387eccc7368e, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:32.239432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.240822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8d7a-6a88-4bd2-9338-cd6cfabafa6b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.246828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 502/1000] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/endpoints?service_id=eec06f7570b74c119719387eccc7368e&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:32.252111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.272374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:32.355401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c94fb-44d7-48b4-91ba-b04b7c2f56e8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.389784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.390398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.390687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.390944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.391543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.392956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.394403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58d38-0616-45c9-b39f-7f93b1bd702e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.394688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58d38-0616-45c9-b39f-7f93b1bd702e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.394966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58d38-0616-45c9-b39f-7f93b1bd702e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.396297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 503/1001] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:32.399778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 499/1002] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:04:32.410796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b992-0865-4045-8ea2-a0698b54beff None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.411227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b992-0865-4045-8ea2-a0698b54beff None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.411602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b992-0865-4045-8ea2-a0698b54beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.438318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2c21b992-0865-4045-8ea2-a0698b54beff None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:32.439697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2c21b992-0865-4045-8ea2-a0698b54beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:32.518249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 504/1003] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:32.541037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.601565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b78df-79d8-4de2-83e7-f396ceefcfa5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.602085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b78df-79d8-4de2-83e7-f396ceefcfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.602085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b78df-79d8-4de2-83e7-f396ceefcfa5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.604108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 505/1004] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:32.609073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.609299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.609578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.627577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:32.628793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:32.632467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:32.658856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33139-128a-4296-bf27-050aa17133a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.696867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.698297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.698576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.698851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.699425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.700802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:32.709416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:32.710443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:32.711293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 500/1005] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:32.713705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 506/1006] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:32.717814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.738907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.749536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:32.829609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4870e-3721-4288-bb90-b407e00b457c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.850603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7d73f-9e7f-4d88-a00c-1374a92a4eaa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.867201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.867740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.868015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.868288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.868955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:32.870104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.871222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.880845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 501/1007] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:32.881862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.894739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.895354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.895630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.895907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.896216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:32.896586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.897986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.915049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 507/1008] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:32 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:32.998218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0388b-1f61-4fbc-916b-20f0aff48b85 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:33.043111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:33.043738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:33.044018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:33.044287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:33.044958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:33.045264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:33.046653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ee9f-a828-4d66-9bf0-28f3e7d10ae5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:33.057389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 502/1009] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:33.058366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:33.128988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:33.163792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf677cc-5ffa-4237-b97b-741ba93eee84 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:33.197788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:33.198389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:33.198661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:33.198927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:33.199587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:33.200964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303149f-caaa-45d6-a7e1-4d5c0d1bf634 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:33.217872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 508/1010] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:34.456886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51da16-0cde-4d7d-a4b4-3d2c913e3eb6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.457379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51da16-0cde-4d7d-a4b4-3d2c913e3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.457457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51da16-0cde-4d7d-a4b4-3d2c913e3eb6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.458898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 503/1011] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:34.464570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.465062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.465297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.483821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:34.485042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:34.561073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 509/1012] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:34.586672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51da16-0cde-4d7d-a4b4-3d2c913e3eb6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:34.664344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:34.698996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51da16-0cde-4d7d-a4b4-3d2c913e3eb6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:34.735079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:34.735737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.736014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.736278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.736879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:34.738236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:34.746951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:34.747960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:34.753816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 504/1013] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:34.756367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:34.812173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:34.860214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037a90-76e9-48f5-a504-447f1781853d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:34.894272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:34.894879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.895155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.895429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.896062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:34.896360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:34.897735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cef117-0577-40c0-aa8d-4039e2d0aa2e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:34.907291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 510/1014] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:34.908864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:34.940345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff88d0-8f3c-4aee-a0c4-cbd784538bda None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.940716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff88d0-8f3c-4aee-a0c4-cbd784538bda None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.940930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff88d0-8f3c-4aee-a0c4-cbd784538bda None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.942266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 511/1015] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:34.947117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.947454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.947770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.965502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:34.966610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:35.031561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c69bc3-11bf-4d8a-adbc-9b3126835d75 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.038395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 512/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:35.061541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.068531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.069592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.069943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.070211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.070832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:35.071126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.073803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.075507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.086236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 505/1017] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Aug 8 02:04:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:35.087998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.113342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.168863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24af4-6e56-47e4-a8c9-83cca2da0bbe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.201929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb87f2-6923-4416-8d3b-90f5b083bf59 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.204049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.204702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.204980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.205248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.205832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.207181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:35.216545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:35.217828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:35.218849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:35.222455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 513/1018] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:35.223343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.245028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.245640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.245917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.246180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.246833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.248205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631349f2-aa9b-463e-9aca-95724727902e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.269044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 506/1019] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:35.270527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e024e-e8fa-4682-b196-4b7ff3bb6f9a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.270799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e024e-e8fa-4682-b196-4b7ff3bb6f9a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.271067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e024e-e8fa-4682-b196-4b7ff3bb6f9a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.272263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 507/1020] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:35.278828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.279123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.279391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.299520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:35.300793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:35.347374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7212b-1299-42d2-82b4-4ecfe6ce8daa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.362338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.362992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.396733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 508/1021] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:35.396936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.396936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.396936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.396936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.397295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:35.397295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.397295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.402353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 514/1022] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:35.407845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.419419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.530823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60519fcc-1915-438a-87ce-c849273dc5b9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.540602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0276-98e8-4cab-8d42-f16147e91913 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.565778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.566382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.566655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.566924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.567546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] RBAC: Adding query filter params (type=image) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:35.567842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.569227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.574537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 509/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:35.580385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.580856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.581441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.581714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.581979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.583070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.584478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.586182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 515/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:35.592224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.628490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.642627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.688157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be3db-607e-4f22-bc05-c8f4ba1edc00 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.704731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bed31-13e7-412c-9c49-e269ed945ef6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.724771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.725411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.725686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.725952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.727097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] RBAC: Adding query filter params (interface=public, service_id=5d3978764c4b4b7889a4f83d59d28f4d, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:35.727600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.729099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.734767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 510/1025] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/endpoints?service_id=5d3978764c4b4b7889a4f83d59d28f4d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:35.740242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:35.745396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.746005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.746281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.746551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.747185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.748596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f18c2-7d9f-4b77-b5e6-81f1fba9d4d9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.777252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 516/1026] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:35 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:35.856633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9ff0a-dac8-4689-a323-fb5648bd34e7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:35.866991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:35.895340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:35.895976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:35.896251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:35.896517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:35.897232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:35.898637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a469aa-8d08-4e99-af27-9c40f0376a55 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:35.909022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 511/1027] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:04:35 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:04:37.405155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35895-3fc2-4bbe-83a3-e858134e85e2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.405684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35895-3fc2-4bbe-83a3-e858134e85e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.405684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35895-3fc2-4bbe-83a3-e858134e85e2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.407089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 517/1028] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:37.415290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.415290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.415290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.432405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:37.433826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:37.504275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 512/1029] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:37.530220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35895-3fc2-4bbe-83a3-e858134e85e2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:37.629283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:37.639571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35895-3fc2-4bbe-83a3-e858134e85e2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.673678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:37.674232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.674510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.674780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.685647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-98d471a3-df87-4279-9fe1-ab5a87463ea3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:37.690352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:37.691319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:37.692190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:37.696494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 518/1030] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:37.698525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:37.799708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b300029-71dc-44e2-986d-a351c33a2371 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.801298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:37.836660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:37.837280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.837558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.837847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.838521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:37.838823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:37.840191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:37.848292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d3ad-7b24-4320-bf30-3b97d53024a0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.848577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d3ad-7b24-4320-bf30-3b97d53024a0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.848887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d3ad-7b24-4320-bf30-3b97d53024a0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.849526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 513/1031] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:37.855816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 519/1032] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:37.855948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:37.860139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e24c-6802-4ad7-82d6-6975c0f795ae None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.860422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e24c-6802-4ad7-82d6-6975c0f795ae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.860732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e24c-6802-4ad7-82d6-6975c0f795ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.880216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4546e24c-6802-4ad7-82d6-6975c0f795ae None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:37.881436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4546e24c-6802-4ad7-82d6-6975c0f795ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:37.950724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 520/1033] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:37.951982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e8ae-628c-44a1-b11e-b6c39c176098 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.952259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e8ae-628c-44a1-b11e-b6c39c176098 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.952527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e8ae-628c-44a1-b11e-b6c39c176098 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.953801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 521/1034] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:37.958900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.959179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.959446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.967798 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ecb2-bd8d-4de0-97a5-eb2a8447f2da None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.977363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:37.979148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:38.003919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.004547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.004866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.005140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.015729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.017217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:38.031228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:38.032168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:38.033100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:38.033100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:38.033100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:38.033100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 514/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:38.033479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.049934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 522/1036] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:38.050771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.052045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.073980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.141602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8606d31-bcc1-47c4-aadc-d866a799a90b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.155387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce505-bdac-4c16-a2a1-25a5daeb034a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.175538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.176167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.176446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.176748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.177856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.179318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.181183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 515/1037] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:38.182474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.189897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.190498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.190771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.191038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.191673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:38.191971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.193352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.204743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 523/1038] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:38.205439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.267749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.283847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.284037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabb14-0019-4a78-87a2-a42095881ede None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.307882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac611f-a615-400a-afe6-baee6196f148 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.317571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.318194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.318467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.318731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.319299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.320668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:38.329301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:38.330345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:38.331184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 516/1039] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:38.331997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.345830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.346431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.346705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.346971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.347603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.349037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.370592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 524/1040] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:04:38 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:38.371393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.443719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb043-9448-4984-b11b-8d17b4a526b2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.482327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.483268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.483547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.483816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.492502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265656c5-c94e-43e0-951c-8e179b18b9f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.493088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.494679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:38.508060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:38.509207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:38.510994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 517/1041] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:38.515513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.528763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.531577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.537925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.538556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.539553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.539828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.540455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:38.541952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.543323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.549789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 525/1042] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:38.555610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.645852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5975187-62f7-4fa4-95b9-d3cef60268db None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.670469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce4e9-24d8-4f48-a70f-25b82775a46c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.682887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.683708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.683997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.684266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.685022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:38.685324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.687500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.708108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.708764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.709047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.709319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.715833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 518/1043] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:38.715969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:38.715969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.715969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.716845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.725779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 526/1044] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:38.727352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:38.790299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.790503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:38.830268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f510-2fc8-42f5-8d78-51009fc32b01 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.832901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d509f7-663d-4cd9-b7f4-5cb111861e63 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:38.867360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.868225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.868502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.868856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.870678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:38.871410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:38.871692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:38.871958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:38.872785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.874156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:38.901637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 527/1045] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:04:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:38.945937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:38.948917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.023692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:39.066553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 519/1046] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:38 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:04:39.073442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.186791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4322-5c55-4fbf-b667-2276fe882801 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:39.201070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:39.223866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:39.224791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.225067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.225332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.236259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:39.237733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:39.252543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:39.253537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:39.254479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:39.254479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:39.254479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:39.255125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 528/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:39.259619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.360230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53db355-28fc-404a-ac53-8ef44bb37f03 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:39.394500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:39.395103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.395375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.395638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.396270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:39.396567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:39.398021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.414570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 520/1048] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:39.416792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.523704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669ed-7b93-4c0d-b149-24b35fbf830d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:39.564157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:39.564841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.565124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.565397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.573058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:39.574511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:39.586039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:39.587112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:39.588129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 529/1049] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:39.593242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.623836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:39.698665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda234-3b4f-4a20-814f-dc73193734c3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:39.732542 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:39.733176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.733455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.733724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.734410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:39.734714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:39.736137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f978c-9b0c-4ebe-96bc-b02fc2241ddf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.748541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 521/1050] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:39.754295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.780982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:39.857187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd06c-9198-4f2c-908e-5f37381987c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:39.891763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:39.892292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.892573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.892869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.893594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] RBAC: Adding query filter params (role.id=d753ec2b89f24da7b5f65c4e02ba90aa, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:39.893903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:39.895321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac63c73-f87f-43ec-bd99-489c8ccb8e00 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:39.901236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 530/1051] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:39 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=d753ec2b89f24da7b5f65c4e02ba90aa => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:40.470818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb20-1610-4485-b40d-af7a5950c841 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.471135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb20-1610-4485-b40d-af7a5950c841 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.471371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb20-1610-4485-b40d-af7a5950c841 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.472908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 522/1052] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:40.478057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.478954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.479233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.497417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:40.498610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:40.566480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 531/1053] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:40.589942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbb20-1610-4485-b40d-af7a5950c841 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.681381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.699446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbb20-1610-4485-b40d-af7a5950c841 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.735260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.735892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.736173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.736446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.746761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:40.751467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:40.752424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:40.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 523/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:40.760533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.780727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.865202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72bdf1-8b69-43c7-a127-ad447ae0f0ef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.899561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.900820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.901324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.901324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.901943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:40.902239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:40.903591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753bcac-9a1c-4ca4-b7ce-1171709185f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:40.917087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 532/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:40.918590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.931135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd1171-08cc-4ff4-bf54-eb0cdf9c2c56 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.931629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd1171-08cc-4ff4-bf54-eb0cdf9c2c56 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.931740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd1171-08cc-4ff4-bf54-eb0cdf9c2c56 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.933467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 533/1056] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:40.938357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.938638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.938902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.957254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:40.958437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:41.030276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 534/1057] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:41.031090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65ca2-a7bf-46c5-b0f1-b5542a1d44ea None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.052528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.065451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.070828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.071465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.071806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.072202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] PATH_INFO: `/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.088784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] RBAC: Authorizing `identity:get_user(user_id=1e5e06ae69b04c508ef6d970cd1d5ba0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.090230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.096517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 524/1058] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:41.098233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.102717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.159341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35046931-addc-4a09-bb0e-633c16210ba1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.195363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.195898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.196173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.196442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.207528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c169f-faa3-4994-ad97-8864427bea0f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.244767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.245432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.245710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.245977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.271716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.273342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.284534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.317992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.319481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.322763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.389477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 535/1059] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:04:41.390883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.427681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 525/1060] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:04:41.431149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.507544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13baa-35ab-4ef0-ad64-cc765279ca95 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.519187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.539218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fd82-90fa-4110-8c7e-c6eb526467c1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.545122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.548562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.549222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.549499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.549770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.560965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.562415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:41.577338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:41.578850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:41.579743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:41.579743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:41.579743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:41.579743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 536/1061] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:41.582226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.582860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.583135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.583486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.584389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.585847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.588081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.595959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 526/1062] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:41.597406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.690496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec6b90-33d2-4530-b49e-9d3645a7e8ef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.706752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ede7b-01b8-4ef9-8296-82268895d6f5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.726374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.726978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.727256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.727526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.728294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:41.728853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.730239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9dfa2-fccc-4571-a29f-24540c1707fc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.742087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.742827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 537/1063] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:41.742953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.743034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.743292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.744164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b, user.id=1e5e06ae69b04c508ef6d970cd1d5ba0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:41.744472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.745955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe6eb-3a3d-4bde-a1cd-def4f8dad6c9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.761037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 527/1064] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/role_assignments?user.id=1e5e06ae69b04c508ef6d970cd1d5ba0&scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:41.907930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fc241-2fef-4a5b-a2b4-6e7ac38c5e40 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.908213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fc241-2fef-4a5b-a2b4-6e7ac38c5e40 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.908486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fc241-2fef-4a5b-a2b4-6e7ac38c5e40 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.909897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 538/1065] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:41.915280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.915562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.915835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.934358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:41.935557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:41.968700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.011906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 528/1066] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:42.033777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fc241-2fef-4a5b-a2b4-6e7ac38c5e40 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.061016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.139178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fc241-2fef-4a5b-a2b4-6e7ac38c5e40 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.173290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.173918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.174195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.174461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.184360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:42.189054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:42.190127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:42.191032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 539/1067] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:42.196077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.295057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e60508-f39e-4310-80c4-4937d5632008 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.328045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.328653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.328949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.329227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.329880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:42.330183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:42.331550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:42.340022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 529/1068] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:42.345761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.428040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.448039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec2c6-d533-4626-ad4e-a8130a498430 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.482673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.483296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.483571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.483837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.493674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:42.495259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:42.509269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:42.510967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:42.511894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:42.511894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:42.511894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:42.511894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 540/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:42.516743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.545314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.614417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0acd-8b45-47ad-8a47-e2ea380b97d4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.652352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.652977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.653253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.653522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.654155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:42.654455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:42.655811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:42.667133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 530/1070] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:42.672839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.780569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8049f8-1353-4516-a099-621a306d8544 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.816310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.816898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.817174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.817439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.819307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.826858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:42.828339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:42.839620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:42.840661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:42.842046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 541/1071] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:42.846518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:42.935535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:42.948202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8d3e-9b06-44b5-90fc-fe44e9232303 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:42.981526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:42.982124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:42.982400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:42.982670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:42.983387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:42.983689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:42.985150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.002260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 531/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:04:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:43.007849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.108218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934257-8e14-4eff-b821-c1195f0f4c87 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:43.140663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:43.141297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.141573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.141841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.151974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:43.153429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:43.167604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:43.168779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:43.169968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:43.169968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:43.169968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:43.172790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 542/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:43.174318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.274130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61133dca-1476-4808-a559-63f1421bfaca None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:43.309596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:43.310195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.310469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.310736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.311365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:43.311661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:43.313054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.324634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 532/1074] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:43.330374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.377427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:43.437509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d4bd-6f22-4f45-b9a9-99d36b11682f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:43.471821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:43.472454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.472770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.473047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.480011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:43.481472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:43.492354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:43.493337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:43.494806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 543/1075] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:43.499724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.509044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:43.600947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040482-df85-43f7-92df-1b013412c0ac None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:43.634163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:43.635765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.636044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.636317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.637031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:43.637349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:43.638752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b675de-9f86-4634-91d7-f77614741816 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.651839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 533/1076] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:43.657660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.757531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f15fba-7399-4fe8-802e-9b7952eb3b48 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:43.765098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:43.768052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d898-cb4c-42be-982f-3f0bd5815721 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.768335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d898-cb4c-42be-982f-3f0bd5815721 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.768611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d898-cb4c-42be-982f-3f0bd5815721 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.769963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 534/1077] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:43.774940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.775417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.775702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.792771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:43.792969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:43.793433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.793712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.793984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/d753ec2b89f24da7b5f65c4e02ba90aa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.794075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:43.796106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=dbdc6b9326be4f509f1c085d13187bc4, role_id=d753ec2b89f24da7b5f65c4e02ba90aa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:43.797556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:43.811977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 544/1078] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:43 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/dbdc6b9326be4f509f1c085d13187bc4/roles/d753ec2b89f24da7b5f65c4e02ba90aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:43.860178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:43.868411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 535/1079] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:43.891483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:43.996514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9cbee-add0-42cf-a6f5-d05f59562449 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.030171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.030802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.031076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.031340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.041674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:44.046311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:44.047390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:44.048425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 545/1080] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:44.053820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.152507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691c96-e54a-4b03-9bbe-96b93a698987 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.185710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.186309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.186585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.186851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.187506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:44.187804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.189210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.202671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 536/1081] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:44.203857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.231444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.306930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4887-5eaa-4f92-8004-497cf1d3cc44 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.345228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.345862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.346140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.346414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] PATH_INFO: `/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.347531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] RBAC: Authorizing `identity:get_user(user_id=1e5e06ae69b04c508ef6d970cd1d5ba0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.348990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.350830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 546/1082] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:44.357254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.414739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.462055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7748b2-0a4a-4e50-bbbc-9b697a102f57 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.496357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.497021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.497300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.497570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.498682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.500113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e09f-0f0f-4850-b3d9-1c8e6d7a1e8c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.501930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 537/1083] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:44.507838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.599771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.607158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5445-328a-42d0-afb5-2d3255a04c47 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.640080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.640748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.641046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.641519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b/users/1e5e06ae69b04c508ef6d970cd1d5ba0/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.643641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] RBAC: Authorizing `identity:create_grant(project_id=54e891fcbfbb4ef9a35905f4ce17232b, user_id=1e5e06ae69b04c508ef6d970cd1d5ba0, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.645100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4775-ef5b-4392-8b30-304a3db273ac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.658727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 547/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:44 2022] PUT /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b/users/1e5e06ae69b04c508ef6d970cd1d5ba0/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:45.813824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-d7ed-4462-a1be-88b9c8ab29d5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:45.814362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-d7ed-4462-a1be-88b9c8ab29d5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:45.814362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-d7ed-4462-a1be-88b9c8ab29d5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:45.815762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 538/1085] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:45.820691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:45.821134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:45.821230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:45.839444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:45.840684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:45.912680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 548/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:45.936037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202ff8-d7ed-4462-a1be-88b9c8ab29d5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.035316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202ff8-d7ed-4462-a1be-88b9c8ab29d5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.060462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.069040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.069605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.069880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.070147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.080098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:46.084764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:46.085851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:46.086696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 539/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Aug 8 02:04:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:46.094237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.179294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.196142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1efa-acdc-4065-8bea-449d475587a3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.230625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.231220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.231493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.231762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.232412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:46.232741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.234090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.241861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 549/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:46.247557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.348835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ab3d-9a21-4421-bcf8-9e40e5fb1ae7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.383101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.383716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.383988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.385190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.394954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.396372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:46.411673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:46.412861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:46.413861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:46.413861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:46.413861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:46.413861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 540/1089] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:46.419133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.520402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79bd6-8d1c-41b5-b8f5-aa91fb76fbf0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.552892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.553494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.553769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.554036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.554676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:46.554975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.556872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbad83-4823-4efc-b793-a02f964d8e5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.573426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 550/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:46.574688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.614738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.652367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f45aa-8a9b-4cde-8e49-19f3c72e19b0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.652669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f45aa-8a9b-4cde-8e49-19f3c72e19b0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.652955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f45aa-8a9b-4cde-8e49-19f3c72e19b0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.654304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 551/1091] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:46.659804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.660092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.660364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.672305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.678225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988b53-d4e7-44e5-bf28-8e6ac7125c27 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.678402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:46.679577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:46.713265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.713896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.714171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.714439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.721294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.722724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:04:46.734774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:46.735756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:46.736761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 541/1092] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:46.741493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.748687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 552/1093] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:46.772021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.837182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.841173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6ce-3dcd-4049-9380-4a22952669de None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.870745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa49c28-8c87-4642-847d-16f6022a5763 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.876837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.877440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.877720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.877991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.878714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:46.879017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.880444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.897142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 542/1094] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:46.902856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.907389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.908014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.908296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.908561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.911183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.922070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:46.926730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:46.927726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:04:46.928634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 553/1095] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:46.934519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.005693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081d83f-7164-4767-8926-78f322da8290 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.034389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b45c2-9944-49c4-bd57-87651e628e91 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.038484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.039093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.039370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.039639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.065927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.069453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.070054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.070375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.070648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.071301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:47.071604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.072988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.081072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 554/1096] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:47.086725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.112516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.113998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.144714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.187351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538d905-49de-457b-99b6-f9a8edcf035d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.212206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 543/1097] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:47.218568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.220990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.221632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.221902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.222171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] PATH_INFO: `/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.223305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] RBAC: Authorizing `identity:get_user(user_id=1e5e06ae69b04c508ef6d970cd1d5ba0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.225024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.226711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 555/1098] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/users/1e5e06ae69b04c508ef6d970cd1d5ba0 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:47.232298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.277887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.321165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4ae9-bc94-4d50-8f42-ec0e235d59e7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.330508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841547-547c-45ff-a869-f460e04a2d46 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.354875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.355079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.355693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.355979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.356246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.363949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.364550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.364862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.365137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.366341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.367771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:47.383513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:47.384692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:47.385622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:47.385622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:47.385622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:47.385622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 544/1099] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:47.390349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.434708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.436157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.492886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51912-a9c5-4bce-9f12-27f4b1a062d5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.501775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.527499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.528097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.528370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.528633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.529291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:47.529588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.530931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.535125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 556/1100] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:04:47.542014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.544896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 545/1101] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:47.550135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.567647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.641266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19901611-58e6-47b2-87b3-2090af196f98 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.648399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cdce-d461-4f21-b700-9578c94c7d5d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.674945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.675557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.675834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.676110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.677236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.678654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.680336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 557/1102] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:47.682666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.683291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.683573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.683848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.687463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.691899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.693374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:04:47.704481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:47.705588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:04:47.706929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 546/1103] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:47.711211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.741067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.784890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:47.792607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955f8a-2279-488a-9ca8-153d7dbc80cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.814420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed496ced-2aff-4704-90cf-d819364e1038 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:47.827068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.827669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.827948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.828215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.828968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b, user.id=1e5e06ae69b04c508ef6d970cd1d5ba0) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:47.829271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.830688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.836509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 558/1104] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/role_assignments?user.id=1e5e06ae69b04c508ef6d970cd1d5ba0&scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:47.849326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:47.850080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:47.850447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:47.850785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:47.851566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:47.851876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:47.853412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab1f11-7295-4317-9107-969d18f85366 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.866484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 547/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:47.872845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:47.977919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74165e6-83c3-4092-a795-090550a45f37 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:48.014490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:48.015096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:48.015371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:48.015643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:48.016352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] RBAC: Adding query filter params (role.id=d753ec2b89f24da7b5f65c4e02ba90aa, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=dbdc6b9326be4f509f1c085d13187bc4) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:48.016726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:48.018133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973e0a3-f42a-4207-bf83-5785c15512a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:48.023968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 559/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:47 2022] GET /identity/v3/role_assignments?user.id=dbdc6b9326be4f509f1c085d13187bc4&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=d753ec2b89f24da7b5f65c4e02ba90aa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:49.868115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75308c-9611-4413-8f81-c1a0cbee712d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:49.868811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75308c-9611-4413-8f81-c1a0cbee712d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:49.868811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75308c-9611-4413-8f81-c1a0cbee712d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:49.870526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 548/1107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:49.875539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:49.875909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:49.876077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:49.894488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:49.895656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:49.912421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:49.961419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 560/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:49.985758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75308c-9611-4413-8f81-c1a0cbee712d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.073022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.085992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75308c-9611-4413-8f81-c1a0cbee712d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.119358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.119896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.120170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.120437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.121553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:50.122979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ce76-84c1-4699-a202-d7bc0fd08485 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:50.124513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 549/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:50.130127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.224898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b1d7c-8c5c-43f3-9cad-1c9dd3c04ab4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.257699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.258281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.258553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.258820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.260131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:50.261556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c9a0-843b-4723-afaf-3ecfd42fc9fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:50.281495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 561/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:52.309961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd063-e0f2-4584-9dd6-04fbdb850d84 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.310515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd063-e0f2-4584-9dd6-04fbdb850d84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.310515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd063-e0f2-4584-9dd6-04fbdb850d84 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.311833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 550/1111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:52.316916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.317291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.317461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.335673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:52.336885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:52.339639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.404610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 562/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:04:52.427497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd063-e0f2-4584-9dd6-04fbdb850d84 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.527242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd063-e0f2-4584-9dd6-04fbdb850d84 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.559886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.560547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.560808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.561082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] PATH_INFO: `/v3/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.562455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] RBAC: Authorizing `identity:get_role(role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.563816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.565149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 551/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/roles/a865e4a5849e49a0803176776de27f92 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.571016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.667952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40204b61-092b-447a-8645-fd5a62e2dcb5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.701427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.702046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.702323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.702592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] PATH_INFO: `/v3/users/78c7d04317db4c3ea4ab1243f0518c71` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.709692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.716204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] RBAC: Authorizing `identity:get_user(user_id=78c7d04317db4c3ea4ab1243f0518c71)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.717656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.719249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 563/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/users/78c7d04317db4c3ea4ab1243f0518c71 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.725460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.751712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.824964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaaff-0acb-4636-9846-d709ae040191 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.857600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.858205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.858484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.858755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.923505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.924980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.948546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:53.021044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 552/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:53.027050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:53.126107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea5483-15b4-430e-b19d-e8af9a67c9ee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:53.158752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:53.159375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:53.159654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:53.159923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.161061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.162468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8910-de6d-4261-96bd-0dfd5aeda3a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.164080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 564/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:53 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:53.171013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:53.267829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cc53-b72d-4160-bc76-cb590b69935d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:53.291185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:53.301809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:53.302403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:53.302677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:53.302943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.303651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b, user.id=78c7d04317db4c3ea4ab1243f0518c71) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:53.303953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.305395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19272c59-4362-41e9-8b28-e5b9b4f81c49 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.310650 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 553/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:53 2022] GET /identity/v3/role_assignments?user.id=78c7d04317db4c3ea4ab1243f0518c71&scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b&role.id=a865e4a5849e49a0803176776de27f92 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.273782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02bd2-a0e2-46d5-a2cb-ac132f82c572 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.274442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02bd2-a0e2-46d5-a2cb-ac132f82c572 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.274442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02bd2-a0e2-46d5-a2cb-ac132f82c572 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.276329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 565/1118] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:55.281706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.282137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.282235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.300293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:55.301540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:55.365428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 554/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:55.388017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb02bd2-a0e2-46d5-a2cb-ac132f82c572 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.454865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.493107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb02bd2-a0e2-46d5-a2cb-ac132f82c572 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.525933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.526498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.526777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.527048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] PATH_INFO: `/v3/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.528420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] RBAC: Authorizing `identity:get_role(role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.529821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.531143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 566/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/roles/a865e4a5849e49a0803176776de27f92 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.537017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.632195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac60c5-87e9-40f0-9697-ae970232aca6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.648491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.666776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.667402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.667681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.667953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] PATH_INFO: `/v3/users/78c7d04317db4c3ea4ab1243f0518c71` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.669088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] RBAC: Authorizing `identity:get_user(user_id=78c7d04317db4c3ea4ab1243f0518c71)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.670522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.672091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 555/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/users/78c7d04317db4c3ea4ab1243f0518c71 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.677874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.773895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56f68-7e8d-4419-b453-be75ab377393 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.802360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.808165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.808820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.809103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.809375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.810478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.811891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f876e4-0803-413f-a922-d8ce67158591 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.813538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 567/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.819538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.917232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a581d-785a-4504-9493-eac7e1e6d3fb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.949913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.950544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.950823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.951092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b/users/78c7d04317db4c3ea4ab1243f0518c71/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.953190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] RBAC: Authorizing `identity:create_grant(project_id=54e891fcbfbb4ef9a35905f4ce17232b, user_id=78c7d04317db4c3ea4ab1243f0518c71, role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.954603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d666f-56ff-4699-8858-70621b79ed1b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.967145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 556/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:55 2022] PUT /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b/users/78c7d04317db4c3ea4ab1243f0518c71/roles/a865e4a5849e49a0803176776de27f92 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:57.934417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308844-a998-451c-99cf-0da71e3326a0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.934975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308844-a998-451c-99cf-0da71e3326a0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.934975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308844-a998-451c-99cf-0da71e3326a0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.936284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 568/1124] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:57.941327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.941745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.941855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.960120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:57.961333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:58.002298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.028093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 557/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:04:58.051294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308844-a998-451c-99cf-0da71e3326a0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.150580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308844-a998-451c-99cf-0da71e3326a0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.182333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.182934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.183206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.183473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] PATH_INFO: `/v3/roles/a865e4a5849e49a0803176776de27f92` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.184903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] RBAC: Authorizing `identity:get_role(role_id=a865e4a5849e49a0803176776de27f92)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.186197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.187480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 569/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/roles/a865e4a5849e49a0803176776de27f92 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.193456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.290378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487330f-0eb9-4e3a-8131-212b35fc75fc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.323768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.324378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.324673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.324959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] PATH_INFO: `/v3/users/78c7d04317db4c3ea4ab1243f0518c71` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.326070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] RBAC: Authorizing `identity:get_user(user_id=78c7d04317db4c3ea4ab1243f0518c71)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.327495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.329103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 558/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/users/78c7d04317db4c3ea4ab1243f0518c71 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.334633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.398779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.432152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99f11b-0368-454d-978a-df04efdb8ae0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.466569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.467099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.467369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.467632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.532232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.533691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.594653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.627568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 570/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:04:58.633446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.678817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.731905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674a26e-0589-4de6-ba66-2e9c2190b924 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.764663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.765289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.765549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.765813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] PATH_INFO: `/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.766898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] RBAC: Authorizing `identity:get_project(project_id=54e891fcbfbb4ef9a35905f4ce17232b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.768308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb36b-f010-4f62-8062-2b940ad19858 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.769932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 559/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/projects/54e891fcbfbb4ef9a35905f4ce17232b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.776081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.872724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212105f-ea6c-4428-bd28-e02cece5eb1f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.906303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.906890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.907165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.907431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.908136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] RBAC: Adding query filter params (role.id=a865e4a5849e49a0803176776de27f92, scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b, user.id=78c7d04317db4c3ea4ab1243f0518c71) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:58.908436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.909864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096eaa-c324-46ca-b739-6c5032464a56 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.915709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 571/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/role_assignments?user.id=78c7d04317db4c3ea4ab1243f0518c71&scope.project.id=54e891fcbfbb4ef9a35905f4ce17232b&role.id=a865e4a5849e49a0803176776de27f92 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:00.940281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb061a-3cfe-4034-8a89-7e698b8665ec None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.940863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb061a-3cfe-4034-8a89-7e698b8665ec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.940863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb061a-3cfe-4034-8a89-7e698b8665ec None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.942198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 560/1131] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:00.947471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.947896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.947998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.966124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:00.967291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:00.992508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.032128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 572/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:05:01.055615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb061a-3cfe-4034-8a89-7e698b8665ec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.156490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb061a-3cfe-4034-8a89-7e698b8665ec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.169439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.190227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.190894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.191121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.191389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.192483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.193933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882276-bace-4b90-832f-8fc3921fecfb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.195474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 561/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:01.201735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.297749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462d35a-c93d-411b-aa92-649a6d867956 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.330499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.331085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.331360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.331629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.332272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.333712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ad7d0-1845-4efe-b684-04ac7a2fa97d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.360066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 573/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:05:01 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:03.385805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab667f6-e7f5-4d91-ab87-1ec5dedb3b57 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.386369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab667f6-e7f5-4d91-ab87-1ec5dedb3b57 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.386369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab667f6-e7f5-4d91-ab87-1ec5dedb3b57 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.387692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 562/1135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:03.392885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.393387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.393483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.411288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:03.412494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:03.422449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.480021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 574/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:03.504552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab667f6-e7f5-4d91-ab87-1ec5dedb3b57 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.603254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab667f6-e7f5-4d91-ab87-1ec5dedb3b57 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.636093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.636654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.636942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.637207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.638290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.639704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a43a-b6e9-4db4-ada5-c20a19f05835 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.641258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 563/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:03.646910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.743556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e2bd4-22eb-44be-a6b2-8e442b2e679b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.776268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.776943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.777217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.777479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.778114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.779514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1d54-b8a5-4885-9a28-bbbc353750e3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.796077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.801414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 575/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:03 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:05:05.841306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcad17-639d-4f75-987e-ec5a5defdf7d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.841823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcad17-639d-4f75-987e-ec5a5defdf7d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.841823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcad17-639d-4f75-987e-ec5a5defdf7d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.843093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 564/1139] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:05.848103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.848511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.848635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.867261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:05.868571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:05.932632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 576/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:05.955683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcad17-639d-4f75-987e-ec5a5defdf7d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.005933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.057211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcad17-639d-4f75-987e-ec5a5defdf7d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.090570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.091191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.091518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.091737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.101922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:06.106842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:06.108023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:06.109200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 565/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:06.114302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.209441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985b5f-aeeb-4a21-a238-1eccb021113b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.236794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.243502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.244099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.244377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.244666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.245329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:06.245652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.246998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.254956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 577/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.261260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.359100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb28e6-74c5-42b7-b307-bd6ba3e507be None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.368362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.392506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.393151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.393425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.393690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] PATH_INFO: `/v3/users/fde90ee170194f138e70029fafc334b0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.406868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] RBAC: Authorizing `identity:get_user(user_id=fde90ee170194f138e70029fafc334b0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.408291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.409873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 566/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/users/fde90ee170194f138e70029fafc334b0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.416522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.513788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a4ef-cdfa-4d5c-a518-dd1072dd21ee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.545976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.546561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.546832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.547096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.602869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.612669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.614044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.709002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 578/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:05:06.715380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.813687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bfff8-6a0e-455b-905c-670c79d3a076 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.846917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.847531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.847809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.848081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] PATH_INFO: `/v3/projects/a040b88f02a742f4a94c7676af742417` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.849464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] RBAC: Authorizing `identity:get_project(project_id=a040b88f02a742f4a94c7676af742417)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.850889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1147-e57c-4683-9b1f-e8c1024a1397 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.853186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 567/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/projects/a040b88f02a742f4a94c7676af742417 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.859266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.947909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.956818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdc9f-206d-4c79-933e-b87e7e76c2b2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.991405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.991994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.992271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.992540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.993411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=a040b88f02a742f4a94c7676af742417, user.id=fde90ee170194f138e70029fafc334b0) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:06.993714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.995121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3d7fe-993c-4c0e-b479-11bd6363d24d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:07.000310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 579/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/role_assignments?user.id=fde90ee170194f138e70029fafc334b0&scope.project.id=a040b88f02a742f4a94c7676af742417&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:08.971715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65d1a-cb2e-4368-b598-7ffb4fbf5ea0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.972282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65d1a-cb2e-4368-b598-7ffb4fbf5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.972282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65d1a-cb2e-4368-b598-7ffb4fbf5ea0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.973616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 568/1147] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:08.979698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.980117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.980230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.997826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:08.999003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:09.063771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 580/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:09.085600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65d1a-cb2e-4368-b598-7ffb4fbf5ea0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.121300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.187280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65d1a-cb2e-4368-b598-7ffb4fbf5ea0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.220176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.220826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.221107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.221379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.232269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:09.236866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:09.237950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:09.238985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 569/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:09.244193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.324522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.339819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341d01f-6e61-4c0c-ac62-742bc167af26 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.372335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.372950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.373224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.373489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.374139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:09.374435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.375773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.384075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 581/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.389878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.482507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.489449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593e10-d90f-4925-a0c9-6094c9632a02 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.522994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.523613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.524619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.524826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] PATH_INFO: `/v3/users/fde90ee170194f138e70029fafc334b0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.525946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] RBAC: Authorizing `identity:get_user(user_id=fde90ee170194f138e70029fafc334b0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.527375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.528978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 570/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/users/fde90ee170194f138e70029fafc334b0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.534869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.631684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da5dc-1ba5-4978-bc23-0c7863d2a49d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.664462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.665110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.665382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.665650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] PATH_INFO: `/v3/projects/a040b88f02a742f4a94c7676af742417` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.666752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] RBAC: Authorizing `identity:get_project(project_id=a040b88f02a742f4a94c7676af742417)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.668154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368fa9f-b47c-49e2-9fb5-e2987cba3904 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.669777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 582/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/projects/a040b88f02a742f4a94c7676af742417 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.675571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.773092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52621-a354-48c0-b82f-75c9d59b59cd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.805565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.806206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.806477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.806737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] PATH_INFO: `/v3/projects/a040b88f02a742f4a94c7676af742417/users/fde90ee170194f138e70029fafc334b0/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.808598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] RBAC: Authorizing `identity:create_grant(project_id=a040b88f02a742f4a94c7676af742417, user_id=fde90ee170194f138e70029fafc334b0, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.810033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe325d6-ebb2-48a7-9f7e-f072d2cab1be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.824085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 571/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:09 2022] PUT /identity/v3/projects/a040b88f02a742f4a94c7676af742417/users/fde90ee170194f138e70029fafc334b0/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:11.774791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138dc9-6854-4616-90a0-c786b741e559 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.775305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138dc9-6854-4616-90a0-c786b741e559 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.775305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138dc9-6854-4616-90a0-c786b741e559 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.776592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 583/1154] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:11.782605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.783029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.783170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.801304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:11.802479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:11.819027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:11.868718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 572/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:11.891575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a138dc9-6854-4616-90a0-c786b741e559 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:11.909725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:11.991958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a138dc9-6854-4616-90a0-c786b741e559 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.025417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.025965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.026240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.026508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.036633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:12.041926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:12.043028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:05:12.043923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 584/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:12.049014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.144791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00394b2-3218-4fcf-bb1c-032ee72247b6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.177428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.178017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.178289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.178561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.179203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:12.179498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.181069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.188739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 573/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:12.194583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.268911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.292401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5096-7086-40a5-924b-254b3f67affc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.324172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.324866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.325142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.325407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] PATH_INFO: `/v3/users/fde90ee170194f138e70029fafc334b0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.326488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] RBAC: Authorizing `identity:get_user(user_id=fde90ee170194f138e70029fafc334b0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.327901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.329462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 585/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/users/fde90ee170194f138e70029fafc334b0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:12.335270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.351731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.434948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851f0-6506-4829-913b-3a00f60039e0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.468395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78be501-1613-4975-b524-9978973329a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.469019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78be501-1613-4975-b524-9978973329a7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.469298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78be501-1613-4975-b524-9978973329a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.469567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78be501-1613-4975-b524-9978973329a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.535008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78be501-1613-4975-b524-9978973329a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.536448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78be501-1613-4975-b524-9978973329a7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.550122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.631554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 574/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:05:12.638187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.736093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81189047-7b97-4e2b-9e5a-cf64c62f7838 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.769112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.769720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.769997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.770265 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] PATH_INFO: `/v3/projects/a040b88f02a742f4a94c7676af742417` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.771366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] RBAC: Authorizing `identity:get_project(project_id=a040b88f02a742f4a94c7676af742417)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.772821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f11d4-2527-4c3f-9a06-98567131df9b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.774593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 586/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/projects/a040b88f02a742f4a94c7676af742417 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:12.780583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78be501-1613-4975-b524-9978973329a7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.876046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78be501-1613-4975-b524-9978973329a7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.890199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.910039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.910634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.910909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.911175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.911884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=a040b88f02a742f4a94c7676af742417, user.id=fde90ee170194f138e70029fafc334b0) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:12.912185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.913633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc211a8b-da33-4f93-9610-33c780221b37 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.919321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 575/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/role_assignments?user.id=fde90ee170194f138e70029fafc334b0&scope.project.id=a040b88f02a742f4a94c7676af742417&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:14.929539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f5c9-2965-4812-9c3b-374b62b4f744 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.930102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f5c9-2965-4812-9c3b-374b62b4f744 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.930879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f5c9-2965-4812-9c3b-374b62b4f744 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.932664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 587/1162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:14.937828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.938205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.938365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.955898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:14.957093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:15.021153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 576/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:15.043953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3f5c9-2965-4812-9c3b-374b62b4f744 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.059115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.142548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3f5c9-2965-4812-9c3b-374b62b4f744 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.175572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.176166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.176446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.176748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.241644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.243136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.255916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.339387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 588/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:05:15.345410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.442186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a07d-0cc3-4f74-8bb4-d980da954294 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.452477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.477371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.477983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.478262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.478529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.485076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.486512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e1a56c31-bbd1-4d8a-9eb3-c644ee75900f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:15.497883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:15.499046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:15.499942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 577/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:15.504900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.601575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066cfd8-25eb-41fe-9bd9-3400c066c6d2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.614386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.635878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.636474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.636782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.637057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.637695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:15.637997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.639355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717c81-7668-4426-9db6-7cc93e15f16c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.646259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 589/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:17.631667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3254-8bc8-4465-96dc-028090636ac3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.632184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3254-8bc8-4465-96dc-028090636ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.632184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3254-8bc8-4465-96dc-028090636ac3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.633809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 578/1167] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:17.638989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339aaf5-b19c-4815-9d2e-4f2b7b333229 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.639408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339aaf5-b19c-4815-9d2e-4f2b7b333229 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.639535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339aaf5-b19c-4815-9d2e-4f2b7b333229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.657185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b339aaf5-b19c-4815-9d2e-4f2b7b333229 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:17.658385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b339aaf5-b19c-4815-9d2e-4f2b7b333229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:17.723562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 590/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:17.747288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3254-8bc8-4465-96dc-028090636ac3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.845154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3254-8bc8-4465-96dc-028090636ac3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.878578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.879168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.879444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.879713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.880357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.881747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885643de-7e51-4bbd-b3bf-afaaf46ec014 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.897291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 579/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Aug 8 02:05:17 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:19.902670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180c9-b7a2-4bf3-99a7-f0f1a255e066 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.903185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180c9-b7a2-4bf3-99a7-f0f1a255e066 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.903185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180c9-b7a2-4bf3-99a7-f0f1a255e066 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.904555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 591/1170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:19.909534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.909954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.910085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.928244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:19.929452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:19.952531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.997155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 580/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:20.019693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8180c9-b7a2-4bf3-99a7-f0f1a255e066 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.119066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8180c9-b7a2-4bf3-99a7-f0f1a255e066 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.126783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:20.153022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.153574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.153849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.154116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] PATH_INFO: `/v3/domains/4b424b40f7514285954447938c192e17` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.164674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b424b40f7514285954447938c192e17)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:20.166108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec915b3-9819-4921-96dc-64f9790a8f85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:20.167672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 592/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Aug 8 02:05:20 2022] GET /identity/v3/domains/4b424b40f7514285954447938c192e17 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:20.173371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.270355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df1f5f-1db6-49a4-be36-04bdc8026b03 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.304023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.304721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.305356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.305356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.305893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:20.307310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff12bb-7d47-4ae4-b0ed-d8fcf661e9dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:20.332444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 581/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:05:20 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:22.369482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddefa2-1dda-46ff-8bba-19ac65dfc218 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.370006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddefa2-1dda-46ff-8bba-19ac65dfc218 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.370006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddefa2-1dda-46ff-8bba-19ac65dfc218 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.371366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 593/1174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:22.376589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.376983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.377154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.394764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:22.395930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:22.398859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.462507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 582/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:22.487098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddefa2-1dda-46ff-8bba-19ac65dfc218 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.584126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddefa2-1dda-46ff-8bba-19ac65dfc218 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.617770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.618417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.618691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.618958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] PATH_INFO: `/v3/domains/4b424b40f7514285954447938c192e17` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.620051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b424b40f7514285954447938c192e17)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.621488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714d4e3-8a7b-40b1-a5d3-39f7582247ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.623020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 594/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/domains/4b424b40f7514285954447938c192e17 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:22.628669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.723690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb3a27-a89c-4dc9-8f2b-4ac5ef5697f3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.757110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.757726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.757999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.758263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.758902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.760308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4ae79-72df-408d-8927-274b88ca3c9f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.771660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.783641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 583/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:22 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:24.813067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19f63-2b37-42cf-811d-61d4ff4d707c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.813591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19f63-2b37-42cf-811d-61d4ff4d707c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.813591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19f63-2b37-42cf-811d-61d4ff4d707c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.814858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 595/1178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:24.820861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.821391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.821391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.839051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:24.840221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:24.909555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 584/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:24.933146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19f63-2b37-42cf-811d-61d4ff4d707c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:24.968741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.035691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19f63-2b37-42cf-811d-61d4ff4d707c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.069951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.071549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.071818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.072083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.082226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:25.087278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:25.088393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:05:25.089445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 596/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:25.095037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.193558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e31f9-17aa-4141-9441-eca74f456fd9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.218022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.227737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.228329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.228603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.228910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.229563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:25.229860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.231215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.238954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 585/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.245270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.337359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.344457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727328-315d-4500-9f4e-e2a42b47143e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.377845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.378462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.378737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.379006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] PATH_INFO: `/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.392165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] RBAC: Authorizing `identity:get_user(user_id=94d644e5a9d646aa8187a3a2fb9c9d16)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.393622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.395217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 597/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.401561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.502592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c6a79-185f-486e-bea9-f48e61055a4f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.535849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.536447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.536749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.537020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.591368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.604802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.606240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.702353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 586/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:05:25.708314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.804291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4dad-29e3-4dd3-b601-ecd4ccff13b7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.837702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.838307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.838580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.838843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] PATH_INFO: `/v3/projects/55df016ab75c428599595a46067194e6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.839929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] RBAC: Authorizing `identity:get_project(project_id=55df016ab75c428599595a46067194e6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.841343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b153-46bd-47ee-bbef-27ff2daf2d24 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.842983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 598/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/projects/55df016ab75c428599595a46067194e6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.849194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.935243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.947195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de7ec-39d4-452b-a6a0-09d1a506ea70 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.980154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.980930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.981214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.981486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.982194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=55df016ab75c428599595a46067194e6, user.id=94d644e5a9d646aa8187a3a2fb9c9d16) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:25.982496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.983906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9329e2-49ec-4287-bf91-14427ab1c428 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.989082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 587/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/role_assignments?user.id=94d644e5a9d646aa8187a3a2fb9c9d16&scope.project.id=55df016ab75c428599595a46067194e6&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:27.954208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f31e-40cd-47f2-b278-aa2eeedfafb0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.954753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f31e-40cd-47f2-b278-aa2eeedfafb0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.954753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f31e-40cd-47f2-b278-aa2eeedfafb0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.956097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 599/1186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:27.962578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.963004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.963104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.982654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:27.983812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:28.049551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 588/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:28.071221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756f31e-40cd-47f2-b278-aa2eeedfafb0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.092728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.169603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756f31e-40cd-47f2-b278-aa2eeedfafb0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.203079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.203684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.203956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.204268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.214322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:28.218907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:28.220034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:05:28.221151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 600/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:28.226227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.304840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.323313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53347593-fa98-433b-90e6-ba24e10155d0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.356470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.357089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.357363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.357626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.358273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:28.358569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.359923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.367869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 589/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.373750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.453086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.472350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d74b-0e63-491f-afa1-1d852d6a9427 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.504729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.505345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.505621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.505892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] PATH_INFO: `/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.506989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] RBAC: Authorizing `identity:get_user(user_id=94d644e5a9d646aa8187a3a2fb9c9d16)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.509153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.510713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 601/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.516582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.613091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a1f1-21f1-41ae-88a5-b92337210d47 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.645638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.646253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.646528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.646794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] PATH_INFO: `/v3/projects/55df016ab75c428599595a46067194e6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.647882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] RBAC: Authorizing `identity:get_project(project_id=55df016ab75c428599595a46067194e6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.649350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5364214-8f26-48d9-aaec-e5b03309eb61 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.650931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 590/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/projects/55df016ab75c428599595a46067194e6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.656908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.753550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405d77-2c53-41af-87b2-5718463e764d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.786014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.786657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.786936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.787233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] PATH_INFO: `/v3/projects/55df016ab75c428599595a46067194e6/users/94d644e5a9d646aa8187a3a2fb9c9d16/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.789163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] RBAC: Authorizing `identity:create_grant(project_id=55df016ab75c428599595a46067194e6, user_id=94d644e5a9d646aa8187a3a2fb9c9d16, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.790574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80a894-e9b7-4365-971f-bdd0cf65a881 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.805922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 602/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:28 2022] PUT /identity/v3/projects/55df016ab75c428599595a46067194e6/users/94d644e5a9d646aa8187a3a2fb9c9d16/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:30.774690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cb59-1126-46d3-87a7-527646e2683d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.775201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cb59-1126-46d3-87a7-527646e2683d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.775201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cb59-1126-46d3-87a7-527646e2683d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.776505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 591/1193] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:30.781592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.781975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.782143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.800245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:30.801464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:30.803381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.868426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 603/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:05:30.891250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9cb59-1126-46d3-87a7-527646e2683d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.906658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.992615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9cb59-1126-46d3-87a7-527646e2683d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.025827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.026377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.026652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.026917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.036616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:31.041990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:31.043172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:05:31.044282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 592/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:31.049105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.148957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d541d-cf6b-4d5f-8b20-200c9682c61a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.181667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.182260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.182538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.182810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.183468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:31.183768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.185156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.189991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.193571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 604/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.199731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.268300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.298635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1b0a-31e0-45e6-838c-998ada30cce9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.331478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.332091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.332369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.332663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] PATH_INFO: `/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.333764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] RBAC: Authorizing `identity:get_user(user_id=94d644e5a9d646aa8187a3a2fb9c9d16)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.335186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.337322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 593/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/users/94d644e5a9d646aa8187a3a2fb9c9d16 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.343198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.440905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c1a74-e182-43b1-a943-58453a07cfce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.474178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.474770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.475043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.475307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.537224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.539509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.541364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.636057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 605/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:05:31.642073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.740462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af7f4f-6493-4d38-9a6c-5be88e9bf5ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.772576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.773822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.774096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.774367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] PATH_INFO: `/v3/projects/55df016ab75c428599595a46067194e6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.775477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] RBAC: Authorizing `identity:get_project(project_id=55df016ab75c428599595a46067194e6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.776930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b60635-0cac-4c96-9483-b8b9c4b85099 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.778516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 594/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/projects/55df016ab75c428599595a46067194e6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.784726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.877488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.880512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a204-71c8-4fef-b511-1b6476bb7667 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.915005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.915534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.915811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.916083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.916829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=55df016ab75c428599595a46067194e6, user.id=94d644e5a9d646aa8187a3a2fb9c9d16) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:31.917136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.918552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1ea7-b527-442f-804c-fefd71fc0c0e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.924105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 606/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/role_assignments?user.id=94d644e5a9d646aa8187a3a2fb9c9d16&scope.project.id=55df016ab75c428599595a46067194e6&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:41.768712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.921587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=18 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.698221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115cbc-fa4a-46d6-a47c-ae8d8a6cdc82 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.698844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115cbc-fa4a-46d6-a47c-ae8d8a6cdc82 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.698844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115cbc-fa4a-46d6-a47c-ae8d8a6cdc82 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.700018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 595/1201] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:26.705660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.706131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.706227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.726170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:26.727389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:26.814270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 607/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:26.839347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115cbc-fa4a-46d6-a47c-ae8d8a6cdc82 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.968461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115cbc-fa4a-46d6-a47c-ae8d8a6cdc82 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.009742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0349754-4164-4273-8210-a30382535268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.010385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0349754-4164-4273-8210-a30382535268 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.010665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0349754-4164-4273-8210-a30382535268 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.010967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0349754-4164-4273-8210-a30382535268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.023058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0349754-4164-4273-8210-a30382535268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.024700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0349754-4164-4273-8210-a30382535268 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d0349754-4164-4273-8210-a30382535268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:27.045359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:27.046614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:27.047620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:27.047620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:27.047620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:27.047620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 596/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:27.052558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.173379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ef86-77f1-4833-9b15-7a16bdd59291 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.211553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.218530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.219278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.219557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.219833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.225519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.225519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.227103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b301-2ac1-4396-916d-956107cfa515 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.244823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 608/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:27.247219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0349754-4164-4273-8210-a30382535268 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.311954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.383681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0349754-4164-4273-8210-a30382535268 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.435792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.436460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.436776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.437071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.437857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.439484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90daa-c36f-4cbc-a79a-945db24bb271 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.465451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 597/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Aug 8 02:06:27 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:29.805765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305030-495f-431d-968b-f960bc2e2238 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.806389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305030-495f-431d-968b-f960bc2e2238 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.806389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305030-495f-431d-968b-f960bc2e2238 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.807727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 609/1206] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:29.814050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.814540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.814741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.835689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:29.836914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:29.918179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 598/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:29.944493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305030-495f-431d-968b-f960bc2e2238 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.066157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305030-495f-431d-968b-f960bc2e2238 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.104637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.105338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.105649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.105960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.122608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:30.128563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:30.129673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:30.131073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 610/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:30.137034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.181191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.268351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0918b-4a13-47d6-bc2b-88a68920a0c9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.309328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.309953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.310286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.310495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.311161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:30.311464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.312864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.326363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 599/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:30.327523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.385729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.461324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0032-4072-4078-8b96-fece0a4cd844 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.501670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.502688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.502965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.503331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.516775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.518391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:30.535028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:30.536194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:30.541656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:30.541656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:30.541656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:30.541656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 611/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:30.543388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.671497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.675151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd68fd5-9c24-48cc-b15b-609079ee336d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.716156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.716795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.717073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.717345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.718130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:30.718301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.719665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.733274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 600/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:30.739771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.859912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64cb80-cd61-4e29-8fba-02b647bbfc33 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.861541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.901311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.901995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.902267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.902673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.912324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.914056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:30.926325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:30.928322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:30.929356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 612/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:30.934872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.049725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43087f0-e29a-4c01-8366-425a3705958b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.092408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.093069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.093384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.093680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.094491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.094893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.096667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.120673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 601/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.126916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.251145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f313-5a53-4491-9e97-cafd506787e6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.292506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.293354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.293669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.293993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.335241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.389007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.390808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.527673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 613/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:31.534368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.559790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.655299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2595f-c750-460a-9169-494a8454f1ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.699439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.700458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.700764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.701056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.713256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.715040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:31.737047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:31.738176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:31.741183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:31.741183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:31.741183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:31.741183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 602/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.746208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.828952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.882274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74c12-f2c3-4bca-8c35-7a93f3e2fc79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.921474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.922070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.922414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.922711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.923411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.923708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.926630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.938918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 614/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.945906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.029538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.063450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100440-28c9-425d-8f0e-4883f3b6969f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.101492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.102119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.102392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.102811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.110538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.112296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:32.125837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:32.127475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:32.128607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 603/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:32.133480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.250890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296e36-6efa-463c-abad-32522d5333bb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.278555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.292759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.293499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.293903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.294381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.295381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:32.295838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.297495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f980-d15b-4b1c-b673-d56761b09d65 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.320676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 615/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:32.321937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.449160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3b58f-9324-4d66-bd0e-10d76ec4fc26 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.480909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.488035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.488669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.489790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.490062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.490948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=3925e5acb5fb4f0dbaf5549b19119161) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:32.491270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.492691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3529109-ea1c-4615-8c75-faae1757fc2f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.498727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 604/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/role_assignments?user.id=3925e5acb5fb4f0dbaf5549b19119161&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:34.576500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d397-0b9f-4263-b2f5-b556f64e58ec None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.577051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d397-0b9f-4263-b2f5-b556f64e58ec None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.577051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d397-0b9f-4263-b2f5-b556f64e58ec None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.578533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 616/1220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:34.584497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.584945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.585083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.607833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:34.609369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:34.685002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 605/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:34.711216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d397-0b9f-4263-b2f5-b556f64e58ec None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.818811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d397-0b9f-4263-b2f5-b556f64e58ec None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.853787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.854413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.854685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.854944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.865326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:34.869965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:34.871049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:34.871922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 617/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:34.877232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.989880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c085-8855-4015-bd0d-0c8c30841ad5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.019274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.031951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.032623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.032957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.033259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.034025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.034330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.035723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.043806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 606/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.049584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.093880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.161632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05ee04-ae3c-4b3b-9f69-42c9d02b0de1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.203299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.203931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.204201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.204468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.215768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.217256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:35.233651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.235149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:35.236507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:35.236507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.236507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:35.236507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 618/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:35.242875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.352442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847191f6-847b-43f1-a0c5-2d18ac429d3a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.388768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.389465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.389804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.390076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.390795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.391150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.392585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.406110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 607/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.413063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.516825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.524858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4be147-4d21-4252-8e00-75715a34987c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.560277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.560930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.561209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.561478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.569017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.570476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:35.582086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.584061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:35.585077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 619/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:35.590221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.647657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.708661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3ad5f-662c-414e-8fa3-a4f660397b8e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.748176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.748924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.749235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.749509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.750382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.750752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.752491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.773314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 608/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.779068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.893777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189834-80e4-45d3-b374-049bac1ec341 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.930923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.931649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.931988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.932297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.946784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.948376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:35.964675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.965837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:35.966888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:35.966888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.966888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:35.966888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 620/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:35.972301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.078069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3d3-e3c1-449b-aacd-59a652559580 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.080404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.114813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.115427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.115701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.115969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.116615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:36.116955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.118329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.130565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 609/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:36.137133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.149164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.250656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b374-0057-42fb-a6b8-ef106cdfbd9c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.285829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.286542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.286818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.287084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.293694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.295277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:36.307531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:36.309385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:36.310517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 621/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:36.314613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.433410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f880e-af2c-495d-9b3d-70c14e284d1f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.472435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.473267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.473784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.474161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.474854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:36.475222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.476950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2040c-fe7a-4d69-be22-26315e0d372f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.490321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 610/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:36.496610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.569215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.607880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe3ce2-f10d-4126-8b56-bb4d97d17359 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.649940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.650604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.650884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.651152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/3925e5acb5fb4f0dbaf5549b19119161/roles/53edeb91dad54ecc997c67e7caf14477` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.669499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=3925e5acb5fb4f0dbaf5549b19119161, role_id=53edeb91dad54ecc997c67e7caf14477)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.671228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec32902-1916-42c2-9827-f5c0ba47510b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.685695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 622/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:36 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/3925e5acb5fb4f0dbaf5549b19119161/roles/53edeb91dad54ecc997c67e7caf14477 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:38.867852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b378-79dc-4f92-b120-977351450b0b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.868389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b378-79dc-4f92-b120-977351450b0b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.868389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b378-79dc-4f92-b120-977351450b0b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.869821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 611/1233] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:38.875061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.875476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.875613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.893817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:38.895445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:38.968776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 623/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:38.992750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2b378-79dc-4f92-b120-977351450b0b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.019678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.105273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2b378-79dc-4f92-b120-977351450b0b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.146236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.146868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.147146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.147412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.159254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:39.164885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:39.165998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:39.167004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 612/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:39.172190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.226370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.285847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c996c-f1fa-488d-98d0-51f27f8f2b6c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.324307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.324962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.325240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.325508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.326180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.326481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.327842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.338118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 624/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:39.344289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.440053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.458036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec60f-1182-40b9-be27-9f3337dd622a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.495332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.495956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.496229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.496494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.507001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.508436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:39.522942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:39.529685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:39.530965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:39.530965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:39.530965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:39.530965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 613/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:39.531278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.640791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf82e0-0cbb-4e7c-bb9d-f3cf0b3bf3b6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.651021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.679986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.680760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.680990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.681378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.682354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.682763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.684416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.699426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 625/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:39.705335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.817054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9efd41-0612-4ee1-a698-8ffa9266e6aa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.854827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.855573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.855925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.856206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.858902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.864824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.866759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:39.880503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:39.882055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:39.883041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 614/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:39.887567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.002874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa56d5-999b-4f6d-b1fe-3ebbcbd82353 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.041947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.042551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.042829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.043102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.043828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:40.044135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.045582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.063757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 626/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:40.070743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.188694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0d94-ceec-4514-9640-a25bf5f7322a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.225221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.225841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.226126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.226400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.297523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:40.308431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.309933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.423442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 615/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:40.429978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.459118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:40.535325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48972216-7244-4123-a076-5c8ed4867202 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.574563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.575197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.575572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.575849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.587923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.589404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:40.606618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:40.608197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:40.609206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:40.609206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:40.609206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:40.609206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 627/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:40.613734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.715675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:40.722541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11384b-cd4e-4ce6-8eb6-e3801e13fef7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.764679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.764679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.764679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.764679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.765203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:40.765203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.766052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.778121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 616/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:40.783739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.870717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:40.896261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d53c9-61ee-4a63-ba6f-00ff1d2b0989 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.932596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.933344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.933715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.934059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.941198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.943756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:40.957280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:40.958985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:40.960086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 628/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:40.964728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:41.069197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b1ee-78e5-49f5-94a8-a0a163fd8745 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:41.107632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:41.108311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.108591 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.108938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.109681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:41.110095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:41.111851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405af97c-4000-4dc5-b3b1-65fb354b1672 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:41.127491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 617/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:41.133808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:41.249668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcdaea-ca6a-4b60-a99a-654c699ec834 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:41.288032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:41.288633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.288941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.289209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.289927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] RBAC: Adding query filter params (role.id=53edeb91dad54ecc997c67e7caf14477, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=3925e5acb5fb4f0dbaf5549b19119161) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:41.290228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:41.291990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdee9d-21eb-4663-b96b-eefb2886f2d1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:41.299731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 629/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:41 2022] GET /identity/v3/role_assignments?user.id=3925e5acb5fb4f0dbaf5549b19119161&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=53edeb91dad54ecc997c67e7caf14477 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:43.479752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa9ff8-6c49-426a-9800-05fdca5aedbf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.480387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa9ff8-6c49-426a-9800-05fdca5aedbf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.480387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa9ff8-6c49-426a-9800-05fdca5aedbf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.481656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 618/1247] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:43.487437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.487916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.488014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.495199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:43.509420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:43.510623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:43.582918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 630/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:43.608164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa9ff8-6c49-426a-9800-05fdca5aedbf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:43.630292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:43.731600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa9ff8-6c49-426a-9800-05fdca5aedbf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:43.769060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:43.770046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.770425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.770790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.782604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:43.787792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:43.788999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:43.790074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 619/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:43.796214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:43.909428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0648f2-507a-46e5-a82e-cca7eb13420e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:43.940308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:43.948159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:43.948795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.949068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.949334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.950005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:43.950305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:43.951711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:43.961460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 631/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:43.967354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.054751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.082093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11c46c-7afa-4e92-bd1f-be6f6ddbde69 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.123287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.123980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.124270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.124587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.137289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.138992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:44.155825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:44.157643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:44.159066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:44.159066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:44.159066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:44.159066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 620/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:44.163891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.278900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe1fe-7e87-4890-ad3a-b859dbd6fede None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.317187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.317912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.318197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.318465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.319117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:44.319397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.320791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.332943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 632/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.338704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.455865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732ef7f-8631-43ee-b41c-ec1c1b239832 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.488181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.497713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.498491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.498768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.499037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.508492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.509969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:44.523059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:44.524472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:44.530297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 621/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:44.531050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.595110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.646070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b0a3-d802-46eb-b854-8570a4fea1ff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.683839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.684607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.685011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.685387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.686248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:44.686626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.688371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.708520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 633/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.715043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.829753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea38e-d039-4ffb-8547-113700fe3ad9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.867717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.868242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.868515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.868808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.930381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.945129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.946671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.053808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 622/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:45.059999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.183996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417f070-09e4-4a43-94bd-338bac8a9724 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.201014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.224755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.225392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.225643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.225906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.236189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.237652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:45.255193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:45.256390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:45.257668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:45.257668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:45.257668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:45.257668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 634/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:45.263193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.359801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.373234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886deaa-9ef1-4e0c-b1c1-0d665b181674 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.406461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.407059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.407331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.407606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.408233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:45.408526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.409912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.422270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 623/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:45.428868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.538350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85adc-8e93-49af-9e84-00ceaffaa6f2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.575561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.576182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.576460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.576760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.585212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.586639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:45.597613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:45.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:45.600105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 635/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:45.605307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.710197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45839-ccdc-47d3-bd6a-96d5d33e2361 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.745529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.746136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.746407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.746672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.747357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:45.747651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.749119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f70680-5f74-4e09-ab85-c35a6c629a9f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.762341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 624/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:45.768306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.796312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.879474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fb9-40c4-4e0c-bf84-6b98d72003d9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.922384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.923189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.923474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.923746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.924694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=3925e5acb5fb4f0dbaf5549b19119161) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:45.925025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.928012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0baf01-873c-4a68-8087-437b4fbcdfe8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.934744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 636/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/role_assignments?user.id=3925e5acb5fb4f0dbaf5549b19119161&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:47.980950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fdc5-0ee4-425d-89cb-b64879683e27 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.981473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fdc5-0ee4-425d-89cb-b64879683e27 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.981473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fdc5-0ee4-425d-89cb-b64879683e27 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.982812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 625/1261] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:47.987892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.988336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.988679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.006318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:48.007497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:48.072525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 637/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:48.094966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fdc5-0ee4-425d-89cb-b64879683e27 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.108115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:48.204326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fdc5-0ee4-425d-89cb-b64879683e27 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.238505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.239054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.239328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.239595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.249410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:48.254096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:48.255258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:48.256533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 626/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:48.261161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.279539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:48.358034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab896419-a857-4787-bf91-3c546ea7efbd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.391588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.392174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.392449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.392744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.393396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:48.393693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:48.395581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:48.403264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 638/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:48.408872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.474755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:48.506991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be45f-1f2a-45f8-8ede-f411a2e96b8f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.541098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.541717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.542010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.542261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.552506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:48.553966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:48.568600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:48.569730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:48.570850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:48.570850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:48.570850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:48.570850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 627/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:48.575354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.654807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:48.673768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e1bc-a169-4678-bfee-b7982d2eea8c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.706291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.707436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.707711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.707980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.708610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:48.708936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:48.710283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:48.721547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 639/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:48.727326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.825181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00983-4387-40fc-9621-e3736a639415 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.844038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:48.858432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.859054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.859332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.859603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.867295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:48.868755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:48.879528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:48.880598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:48.881762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 628/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:48.886356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.984489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b11f07-cb4e-4042-91fd-46350f9d451d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.017071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.017663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.017926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.018195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.018908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:49.019216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.021182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.029561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.039090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 640/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:49.044703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.151788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204845c7-6977-4db9-b7ce-b511b758e804 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.185723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.186345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.186624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.186895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.197726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.199165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:49.213582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:49.214670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:49.215619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:49.215619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:49.215619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:49.215619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 629/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:49.220397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.316746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8102dd-7584-4525-bb8f-8646b715e6c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.350163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.350751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.351029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.351299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.351934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:49.352236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.353615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.364764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 641/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:49.370250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.402077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.469409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6db5d9-507a-487b-ac11-e37591212140 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.502022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.502639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.502913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.503179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.510277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.511714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:49.522948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:49.524016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:49.525698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 630/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:49.529836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.591879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.634076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41517520-b7c7-4492-baf8-a6a7645e32a4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.666457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.666993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.667264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.667528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.668203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:49.668501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.669942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18d76e-7d68-40f2-8914-c863b08d2780 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.682154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 642/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:49.688164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.777098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.785784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe28e-3e5e-4825-a276-f48f1d89a5af None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.818157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.818792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.819069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.819339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] PATH_INFO: `/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/3925e5acb5fb4f0dbaf5549b19119161/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.821206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=352082ece5094e09ac27b3b4f64cc5e9, user_id=3925e5acb5fb4f0dbaf5549b19119161, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.822633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025883f-4450-466e-835d-34c44fbde7c2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.835009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 631/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:49 2022] PUT /identity/v3/projects/352082ece5094e09ac27b3b4f64cc5e9/users/3925e5acb5fb4f0dbaf5549b19119161/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:51.780173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6b6f-a2c0-435f-8545-01024542d798 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.780702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6b6f-a2c0-435f-8545-01024542d798 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.780702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6b6f-a2c0-435f-8545-01024542d798 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.782008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 643/1274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:51.787157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.787545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.787703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.805861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:51.807047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:51.872117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 632/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:51.895794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6b6f-a2c0-435f-8545-01024542d798 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.996018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6b6f-a2c0-435f-8545-01024542d798 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.013469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.030364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.030913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.031189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.031460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.041415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:52.046040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:52.047129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:52.048333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 644/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:52.054027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.133264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.151897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded967-835d-4b94-8e57-32a67e224d32 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.185792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.186386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.186666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.186937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.187589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:52.187890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:52.189297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:52.197343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 633/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:52.203001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.299943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718f624-654e-4021-bd28-c5c50ccd7ee3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.331918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.332594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.332898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.333164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.343141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:52.344546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:52.358791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:52.359936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:52.360927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:52.360927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:52.360927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:52.360927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 645/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:52.366332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.464731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2247a-7300-414a-9fc9-c7cd9b4c500c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.498281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.498873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.499146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.499410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.500036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:52.500331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:52.501712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:52.513343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 634/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:52.520439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.553318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.621928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa219-2e9e-4de0-8786-9b5304d06297 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.654677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.655283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.655556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.655823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.663727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:52.665176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:52.676012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:52.677160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:52.678356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 646/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:52.683208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.686934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.780946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63043a-b8f7-453d-b8f3-e015a83a84e4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.813936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.814486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.814737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.815005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.815720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:52.816063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:52.817516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:52.834511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 635/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:52.840246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:52.930397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.940298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3266-bf21-4f93-a102-a56eaf6e1103 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:52.975016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:52.975606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.975907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.976174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.041761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.043194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.129462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.139854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 647/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:53.146368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.205652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.243644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb002a64-06da-4817-bc33-ad358a742678 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.277278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.277893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.278169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.278440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.288517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.289976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:53.304504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:53.305681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:53.306773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:53.306773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:53.306773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:53.306773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 636/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:53.311176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.407372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249d31b-61c9-45b4-94c0-f66192eb19ae None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.440292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.440996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.441804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.442075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.442705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:53.443003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.444370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.455236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 648/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:53.461003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.558910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9536a2-fc22-4d51-9006-37eeaeee7545 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.573081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.592834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.593449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.593724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.593992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.601302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.602725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:53.614373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:53.615387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Aug 08 02:06:53.621422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 637/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:53.622045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.670060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.718087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b794-ab5a-47f4-8a60-83f67255d0e0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.750946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.751530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.751802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.752067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.752770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:53.753069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.754616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60645d1-bf45-440c-8e53-926cc946bc3d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.766029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 649/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:53.772088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.868707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d355-537a-445c-8743-9764821c3c70 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.901629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.902223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.902499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.902765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.903470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] RBAC: Adding query filter params (role.id=c263d8337db14b7e938c9a63cd631fad, scope.project.id=352082ece5094e09ac27b3b4f64cc5e9, user.id=3925e5acb5fb4f0dbaf5549b19119161) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:53.903770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.905223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a47a-c03b-4a17-8fdd-7d13e3592572 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.910978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 638/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/role_assignments?user.id=3925e5acb5fb4f0dbaf5549b19119161&scope.project.id=352082ece5094e09ac27b3b4f64cc5e9&role.id=c263d8337db14b7e938c9a63cd631fad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:55.912059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285108-5eaa-4300-a1e0-a42235ebccb6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.912600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285108-5eaa-4300-a1e0-a42235ebccb6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.912600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285108-5eaa-4300-a1e0-a42235ebccb6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.913950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 650/1288] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:55.918927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.919329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.919471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.937626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:55.938800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:55.967163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:56.005802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 639/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:56.027803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285108-5eaa-4300-a1e0-a42235ebccb6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:56.130441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285108-5eaa-4300-a1e0-a42235ebccb6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:56.142569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:56.171088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:56.171852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.172306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.172632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.173438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:56.175893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:56.185539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:56.186804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:06:56.187704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 651/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:56.192975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:56.289196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350c16-d6a1-43fa-8ea5-5b05fc9fa91e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:56.321805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:56.322397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.322677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.322948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.323569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:56.323872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:56.325272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c13a8e-7b6f-4676-9478-46716ee7f603 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:56.329927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 640/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Aug 8 02:06:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:56.336078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:56.433819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592642-2250-467a-92cb-f54907a68b9b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:56.466861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:56.467464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.467740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.468010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.468689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:56.468990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:56.470360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d39363-e743-416a-a903-ad94a88b700b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:56.475739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 652/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Aug 8 02:06:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:58.442820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195cec-b518-4a9d-84e1-95ebd4158c21 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.443309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195cec-b518-4a9d-84e1-95ebd4158c21 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.443410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195cec-b518-4a9d-84e1-95ebd4158c21 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.444722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 641/1293] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:58.449678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9a55c-a9c5-421f-a25a-2fcd6daccef5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.450114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9a55c-a9c5-421f-a25a-2fcd6daccef5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.450219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9a55c-a9c5-421f-a25a-2fcd6daccef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.468434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21e9a55c-a9c5-421f-a25a-2fcd6daccef5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:58.469713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21e9a55c-a9c5-421f-a25a-2fcd6daccef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:58.498682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:58.535031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 653/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:58.556918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10195cec-b518-4a9d-84e1-95ebd4158c21 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:58.587181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:58.655369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10195cec-b518-4a9d-84e1-95ebd4158c21 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:58.688341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:58.688898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.689173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.689439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.690069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:58.691601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992077e-15a2-4d02-b487-b37feb5feb78 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:58.704970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 642/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:58 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:00.712364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c51c17-87b6-4ee7-9cc0-567e4d836d67 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:00.712891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c51c17-87b6-4ee7-9cc0-567e4d836d67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:00.712891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c51c17-87b6-4ee7-9cc0-567e4d836d67 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:00.714189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 654/1296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:00.719137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab35661-f80f-4bce-8125-afb20545568d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:00.719555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab35661-f80f-4bce-8125-afb20545568d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:00.719680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab35661-f80f-4bce-8125-afb20545568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:00.738113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cab35661-f80f-4bce-8125-afb20545568d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:00.739292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cab35661-f80f-4bce-8125-afb20545568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:00.809406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 643/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:00.832154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c51c17-87b6-4ee7-9cc0-567e4d836d67 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:00.931611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c51c17-87b6-4ee7-9cc0-567e4d836d67 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:00.964552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:00.965132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:00.965410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:00.965679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:00.966254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:00.967623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:00.976444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:00.977736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:00.978876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 655/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:07:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:00.983594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab35661-f80f-4bce-8125-afb20545568d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:01.001910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:01.081560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab35661-f80f-4bce-8125-afb20545568d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:01.118475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:01.119132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.119344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.119610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.120227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:01.120527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:01.121974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:01.127931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 644/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Aug 8 02:07:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:01.134198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:01.171352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:01.240542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce484bc-79f6-4bbb-adfe-564d2be707ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:01.272036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:01.272625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.272922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.273183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.273859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] RBAC: Adding query filter params (interface=public, service_id=10b51c65715c445d973068e596d868b2, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:01.274156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:01.275494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d4824-3503-4f5b-851b-d2725bd1adf0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:01.280243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 656/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Aug 8 02:07:01 2022] GET /identity/v3/endpoints?service_id=10b51c65715c445d973068e596d868b2&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:01.286428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:01.365859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:01.383625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84308-1cdb-4a38-9a54-ff632ea0c85e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:01.416115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:01.416735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.417009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.417273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.417859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:01.419210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb568d6c-6e07-4c3a-956d-46750718e499 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:01.426482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 645/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Aug 8 02:07:01 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:07:03.383857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbdd08-c1cb-4e37-91cb-a75c9df8ac05 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:03.384377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbdd08-c1cb-4e37-91cb-a75c9df8ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:03.384377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbdd08-c1cb-4e37-91cb-a75c9df8ac05 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:03.385762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 657/1302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:03.390958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:03.391379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:03.391490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:03.409928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:03.411414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:03.476625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 646/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:03.499540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbdd08-c1cb-4e37-91cb-a75c9df8ac05 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:03.593135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:03.600571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbdd08-c1cb-4e37-91cb-a75c9df8ac05 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:03.633104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:03.634152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:03.634152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:03.634362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:03.634814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:03.636162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:03.645481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:03.646682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Aug 08 02:07:03.647711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 658/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Aug 8 02:07:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:03.652569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:03.725545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:03.747959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae643c3-0d5a-4552-b65f-b50fd4416781 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:03.780461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:03.781203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:03.781477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:03.781739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:03.782353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:03.782649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:03.783997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476b17a-85f4-4f7c-a44d-3d36b0eee51c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:03.789023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 647/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Aug 8 02:07:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:03.794671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:03.892357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912cbb1-2799-4d4d-a64c-a9340a9b9f71 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:03.924616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:03.925742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:03.926023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:03.926285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:03.926931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:03.928279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8567b-8c3a-4841-b9f8-328a51e5bc8d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:03.947593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 659/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:07:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:13.786217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=30 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:13.943670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:06.642816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e03-084c-455c-ad77-a881586f1bfe None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:06.643420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e03-084c-455c-ad77-a881586f1bfe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:06.643749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e03-084c-455c-ad77-a881586f1bfe None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:06.646000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 648/1307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:06.651631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec5cd-5c2b-4c3b-a3ed-a14ef7a13f83 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:06.652159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec5cd-5c2b-4c3b-a3ed-a14ef7a13f83 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:06.652159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec5cd-5c2b-4c3b-a3ed-a14ef7a13f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:06.761749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d76ec5cd-5c2b-4c3b-a3ed-a14ef7a13f83 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:06.763010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d76ec5cd-5c2b-4c3b-a3ed-a14ef7a13f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:06.929024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 660/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:08:06.982828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:06.983116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:06.983392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:06.985184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 649/1309] 10.222.0.26 () {54 vars in 965 bytes} [Mon Aug 8 02:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:06.991525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ebb6-c4d4-43b8-90ff-27932bd3645b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:06.991848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ebb6-c4d4-43b8-90ff-27932bd3645b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:06.992081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ebb6-c4d4-43b8-90ff-27932bd3645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:07.080611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1272ebb6-c4d4-43b8-90ff-27932bd3645b None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:07.081846 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1272ebb6-c4d4-43b8-90ff-27932bd3645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:07.103924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:07.163782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 661/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Aug 8 02:08:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:07.173646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:07.175679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:07.305525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca8cc-487e-45f1-843b-a7c897f6db16 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:07.383226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:07.383830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:07.384101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:07.384370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:07.385973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:07.446923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:07.505839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:07.507365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ce9-ed8f-4d39-b64c-3cb55d4a7dc7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:07.526746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 650/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:09.868614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bedf-7817-4ce1-94ff-7cf7b5c93cd0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:09.869171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bedf-7817-4ce1-94ff-7cf7b5c93cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:09.869171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bedf-7817-4ce1-94ff-7cf7b5c93cd0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:09.870691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 662/1312] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:09.876180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439f88-0b82-407f-9f5b-4e991b35ad44 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:09.876620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439f88-0b82-407f-9f5b-4e991b35ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:09.876848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439f88-0b82-407f-9f5b-4e991b35ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:09.949161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7c439f88-0b82-407f-9f5b-4e991b35ad44 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:09.950304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c439f88-0b82-407f-9f5b-4e991b35ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:10.062671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 651/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:10.121960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:10.122234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:10.122507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:10.123878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 663/1314] 10.222.0.26 () {54 vars in 965 bytes} [Mon Aug 8 02:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:10.131002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dabf-aa7a-4059-aff9-8dcd0ee19f41 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:10.131281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dabf-aa7a-4059-aff9-8dcd0ee19f41 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:10.131550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dabf-aa7a-4059-aff9-8dcd0ee19f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:10.145024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:10.218437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a673dabf-aa7a-4059-aff9-8dcd0ee19f41 None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:10.219696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a673dabf-aa7a-4059-aff9-8dcd0ee19f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:10.295237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 652/1315] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Aug 8 02:08:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:10.304301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:10.305881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:10.411498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c841b6-a00c-4ce7-aff5-075f448d84aa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:10.488281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:10.491288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:10.492174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:10.492509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:10.492805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:10.494393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:10.603544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:10.605017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c457b4-7781-4151-bcda-b16ea0ae41e4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:10.623489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 664/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:13.157597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:13.158132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:13.158132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:13.159501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 653/1317] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:13.164618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5645c-d7e3-4f1c-8650-824c34b18ccc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:13.165026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5645c-d7e3-4f1c-8650-824c34b18ccc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:13.165190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5645c-d7e3-4f1c-8650-824c34b18ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:13.229978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e3a5645c-d7e3-4f1c-8650-824c34b18ccc None None] MFA Rules not processed for user `6590f5037f2947a49af15a159de642f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:13.231169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e3a5645c-d7e3-4f1c-8650-824c34b18ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:13.281454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:13.325207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 665/1318] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:13.365234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:13.366755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:13.470858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93f6ef-42e3-4375-b79f-d4510cf01260 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:13.473947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:13.544679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:13.545285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:13.545569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:13.545839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:13.547969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:13.654241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:13.655671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abf40e-7510-4575-acc3-c9705061b09a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:13.673934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 654/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:16.236757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:16.237336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:16.237336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:16.238676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 666/1320] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:16.243710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e87f4-f8d3-4edc-be29-0e84a0701b93 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:16.244124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e87f4-f8d3-4edc-be29-0e84a0701b93 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:16.244277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e87f4-f8d3-4edc-be29-0e84a0701b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:16.285106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:16.309397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2b8e87f4-f8d3-4edc-be29-0e84a0701b93 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:16.310592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2b8e87f4-f8d3-4edc-be29-0e84a0701b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:16.405283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 655/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:16.444203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:16.445809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:16.547923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cfa4-f8ca-4205-a142-5df4819ee975 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:16.618955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:16.619549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:16.619824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:16.620095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:16.621717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:16.629315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:16.729909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:16.731340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b1823-753f-40ea-a5b2-943254e48f54 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:16.750672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 667/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:19.398671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:19.399239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:19.399239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:19.400545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 656/1323] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:19.405674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2a09-3b94-4858-b398-d52851f32aad None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:19.406119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2a09-3b94-4858-b398-d52851f32aad None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:19.406483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2a09-3b94-4858-b398-d52851f32aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:19.473938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2c9f2a09-3b94-4858-b398-d52851f32aad None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:19.475142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2c9f2a09-3b94-4858-b398-d52851f32aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:19.531756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:19.576702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 668/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:19.613924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:19.615477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:19.727613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af129f-bb6c-4a34-a2e9-cebfc1f2dec6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:19.741065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:19.803135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:19.803751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:19.804026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:19.804295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:19.805928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:19.914731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:19.916171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eda15-78d1-4b21-95a3-3260d9846638 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:19.935049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 657/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:08:22.005596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:22.006116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:22.006116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:22.007382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 669/1326] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:22.012675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2283c2-4b77-4692-92ad-85848614b608 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:22.013104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2283c2-4b77-4692-92ad-85848614b608 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:22.013199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2283c2-4b77-4692-92ad-85848614b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:22.061058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:22.080345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3a2283c2-4b77-4692-92ad-85848614b608 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:22.081568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a2283c2-4b77-4692-92ad-85848614b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:22.186904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 658/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:22.223666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:22.225292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:22.329521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86825-34d4-49b2-82ea-e5bec74a1033 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:22.403877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:22.404500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:22.404811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:22.405088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:22.407062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:22.428683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:22.524041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:22.525514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1c28d-758e-4d4f-b3fb-0de53d102a81 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:22.543946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 670/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:24.585924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:24.586472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:24.586472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:24.587804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 659/1329] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:24.593110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e909d-7cf0-4645-a191-187865a4c6f9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:24.593517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e909d-7cf0-4645-a191-187865a4c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:24.593660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e909d-7cf0-4645-a191-187865a4c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:24.661367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-742e909d-7cf0-4645-a191-187865a4c6f9 None None] MFA Rules not processed for user `6590f5037f2947a49af15a159de642f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:24.662561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-742e909d-7cf0-4645-a191-187865a4c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:24.728678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:24.764501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 671/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:24.802099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:24.803713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:24.912165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363db43-fae7-4bdd-b51e-3687defb0662 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:24.932392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:24.986641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:24.987164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:24.987441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:24.987710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:24.989337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:25.100356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:25.101851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1239b-60c1-4c03-9134-6afe997c64a0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:25.120546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 660/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:27.387708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:27.388262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:27.388262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:27.389622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 672/1332] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:27.394670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9feb3-6bd5-45bc-b89d-bc9fe96a7122 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:27.395093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9feb3-6bd5-45bc-b89d-bc9fe96a7122 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:27.395258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9feb3-6bd5-45bc-b89d-bc9fe96a7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:27.459619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:27.462948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-46b9feb3-6bd5-45bc-b89d-bc9fe96a7122 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:27.464554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-46b9feb3-6bd5-45bc-b89d-bc9fe96a7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:27.562819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 661/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:27.599745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:27.601326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:27.705282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353acac-5328-4b9b-8fc0-502da347f5b9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:27.776653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:27.777276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:27.777555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:27.777822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:27.779403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:27.805653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:27.886381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:27.887809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6553e-1ac1-4abc-8035-66eed4838fd6 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:27.907084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 673/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:29.958709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:29.959360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:29.959360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:29.960603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 662/1335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:29.965928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a934-4114-4204-b71b-ee61d96d9c00 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:29.966356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a934-4114-4204-b71b-ee61d96d9c00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:29.966493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a934-4114-4204-b71b-ee61d96d9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:30.032827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7626a934-4114-4204-b71b-ee61d96d9c00 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:30.034027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7626a934-4114-4204-b71b-ee61d96d9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:30.111650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:30.135208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 674/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:08:30.176576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:30.182130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:30.281335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8c160-3990-4517-8592-3b2d3792d2d2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:30.308857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:30.354079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:30.354682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:30.354958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:30.355255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:30.356879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:30.465752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:30.467192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a41af-d659-4a24-baaa-aa8ff89eec10 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:30.486877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 663/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:32.859531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:32.860061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:32.860061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:32.861643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 675/1338] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:32.866846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5846d-1840-4cbb-9fa4-4b4aa03f20a5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:32.867297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5846d-1840-4cbb-9fa4-4b4aa03f20a5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:32.867405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5846d-1840-4cbb-9fa4-4b4aa03f20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:32.932335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-67b5846d-1840-4cbb-9fa4-4b4aa03f20a5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:32.933594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-67b5846d-1840-4cbb-9fa4-4b4aa03f20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:32.942614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:33.030186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 664/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:33.066790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:33.068305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:33.175818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da92cb-db50-4288-bc9e-4361070b66f1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:33.247904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:33.248506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:33.248810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:33.249080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:33.251281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:33.285015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:33.356968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:33.358412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01836-8305-4200-961b-8d4d11fe25c4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:33.376743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 676/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:37.272631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:37.273200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:37.273304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:37.274641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 665/1341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:37.279750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee46e-4a04-4eb5-a06e-8c90d04944d3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:37.280199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee46e-4a04-4eb5-a06e-8c90d04944d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:37.280319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee46e-4a04-4eb5-a06e-8c90d04944d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:37.347667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-993ee46e-4a04-4eb5-a06e-8c90d04944d3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:37.349029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-993ee46e-4a04-4eb5-a06e-8c90d04944d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:37.437600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:37.449236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 677/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:37.489849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:37.491414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:37.595812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cb4d2-0184-4692-98ec-4c727b4fa1d3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:37.634187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:37.672049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:37.672688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:37.672972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:37.673246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:37.674844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:37.785431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:37.786774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4ca32-343b-4480-9837-b60ffd989c93 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:37.805431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 666/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:40.492012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:40.492584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:40.492584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:40.493970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 678/1344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:40.499715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9579-8b76-4fb5-9f2b-601f2107ed5d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:40.500262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9579-8b76-4fb5-9f2b-601f2107ed5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:40.500348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9579-8b76-4fb5-9f2b-601f2107ed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:40.571782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-755a9579-8b76-4fb5-9f2b-601f2107ed5d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:40.573060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-755a9579-8b76-4fb5-9f2b-601f2107ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:40.593498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:40.676119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 667/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:40.713912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:40.715526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:40.820488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940fbeb-0ae4-4cdd-a41f-0c4d7391cbd5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:40.894625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:40.895232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:40.895508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:40.895776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:40.897406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:40.940440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:41.009114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:41.010464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8335c8-1f28-4ccc-8cd3-2f36af3f6a82 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:41.029207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 679/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:45.039089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:45.039670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:45.039670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:45.041012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 668/1347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:45.046993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4ee09-9a57-44fc-8171-7d669345ba94 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:45.047427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4ee09-9a57-44fc-8171-7d669345ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:45.047542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4ee09-9a57-44fc-8171-7d669345ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:45.121812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-96a4ee09-9a57-44fc-8171-7d669345ba94 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:45.123039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-96a4ee09-9a57-44fc-8171-7d669345ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:45.224198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:45.227055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 680/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:45.272526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:45.274258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:45.391298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaf9c7-2a51-42ca-8640-ac5289ea7cea None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:45.444126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:45.473555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:45.474295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:45.474554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:45.474819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:45.476427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:45.595997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:45.597775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22396-26c7-4e29-af70-b7bc0a6ea64f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:45.618219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 669/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:08:50.699268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491146-0689-4c75-8fee-790aa66eb3bb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:50.699758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491146-0689-4c75-8fee-790aa66eb3bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:50.699758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491146-0689-4c75-8fee-790aa66eb3bb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:50.701090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 681/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:50.724711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39889-1593-4bf0-985c-62861f8f24d8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:50.724711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39889-1593-4bf0-985c-62861f8f24d8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:50.724711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39889-1593-4bf0-985c-62861f8f24d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:50.825378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-90c39889-1593-4bf0-985c-62861f8f24d8 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:50.827362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-90c39889-1593-4bf0-985c-62861f8f24d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:50.846899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:50.947052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 670/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:08:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:08:54.936757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51221-b920-474a-b950-11f20f52ef0c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:54.937664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51221-b920-474a-b950-11f20f52ef0c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:54.937943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51221-b920-474a-b950-11f20f52ef0c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:54.939619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 682/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:54.945347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099dfb-b170-49fc-b0a3-ae5f670c6393 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:54.945785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099dfb-b170-49fc-b0a3-ae5f670c6393 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:54.945886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099dfb-b170-49fc-b0a3-ae5f670c6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:55.033549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1e099dfb-b170-49fc-b0a3-ae5f670c6393 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:55.035016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e099dfb-b170-49fc-b0a3-ae5f670c6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:55.110477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:55.152315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 671/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:08:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:08:56.674943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7886c3-494b-4d44-a4b2-7a9fc4df42e4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.675454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7886c3-494b-4d44-a4b2-7a9fc4df42e4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.675688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7886c3-494b-4d44-a4b2-7a9fc4df42e4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.677224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 683/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:56.682614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ee1f-3b6d-4566-8c89-3edfc065ce84 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.683030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ee1f-3b6d-4566-8c89-3edfc065ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.683171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ee1f-3b6d-4566-8c89-3edfc065ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.760351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-74f4ee1f-3b6d-4566-8c89-3edfc065ce84 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:56.761996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-74f4ee1f-3b6d-4566-8c89-3edfc065ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:56.872169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 672/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:08:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:09:00.316628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe76a-3664-4921-b237-0933c004ab4b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.317495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe76a-3664-4921-b237-0933c004ab4b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.317923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe76a-3664-4921-b237-0933c004ab4b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.320845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 684/1356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:00.327999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de2b6-bf03-409c-95ac-7be9daa43b92 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.329835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de2b6-bf03-409c-95ac-7be9daa43b92 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.330290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de2b6-bf03-409c-95ac-7be9daa43b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.393374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:00.447633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-686de2b6-bf03-409c-95ac-7be9daa43b92 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:00.449123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-686de2b6-bf03-409c-95ac-7be9daa43b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:00.570506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 673/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:00.628399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.628976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.629414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.631629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 685/1358] 10.222.0.26 () {54 vars in 962 bytes} [Mon Aug 8 02:09:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:00.640002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea7d28-ad93-4b13-af58-103e7c6bbc5d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.640531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea7d28-ad93-4b13-af58-103e7c6bbc5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.640531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea7d28-ad93-4b13-af58-103e7c6bbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.743791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c2ea7d28-ad93-4b13-af58-103e7c6bbc5d None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:00.745040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c2ea7d28-ad93-4b13-af58-103e7c6bbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:00.797155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:00.870236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 674/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Aug 8 02:09:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:00.877872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.879362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:01.032381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4255d8-c173-47be-8ace-96450bb67c29 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.110482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:01.152900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.153507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.153779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.154042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.156311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:01.259207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.260969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6d230-50ee-4b70-9d43-5c9770c99c88 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.280746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 686/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:03.510530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:03.511112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:03.511585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:03.513357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 675/1361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:03.519976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034011ea-02d7-4d94-af6d-6b293d6f3e42 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:03.520482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034011ea-02d7-4d94-af6d-6b293d6f3e42 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:03.520482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034011ea-02d7-4d94-af6d-6b293d6f3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:03.588453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-034011ea-02d7-4d94-af6d-6b293d6f3e42 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:03.589673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-034011ea-02d7-4d94-af6d-6b293d6f3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:03.628198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:03.692742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 687/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:03.736166 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:03.737804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:03.910424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c3767-e74c-4a50-b994-3f41e47e9345 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:03.920523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.062911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.063670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.064054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.064434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.066195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:04.165153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:04.166752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2e4c-e9ab-45f4-8425-2a929fa0e429 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:04.185347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 676/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:06.584059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aee3f-a072-471d-87ed-9b555ecf7fab None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:06.584609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aee3f-a072-471d-87ed-9b555ecf7fab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:06.584609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aee3f-a072-471d-87ed-9b555ecf7fab None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:06.585988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 688/1364] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:06.591471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee046-b6a1-4fd1-b6ea-8489055cbab9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:06.591926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee046-b6a1-4fd1-b6ea-8489055cbab9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:06.592262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee046-b6a1-4fd1-b6ea-8489055cbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:06.609434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:06.676170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cfeee046-b6a1-4fd1-b6ea-8489055cbab9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:06.677139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cfeee046-b6a1-4fd1-b6ea-8489055cbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:06.782384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 677/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:06.828855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:06.829227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:06.829579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:06.831331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 689/1366] 10.222.0.26 () {54 vars in 962 bytes} [Mon Aug 8 02:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:06.836347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f43f-b845-4f72-ad47-34e9fae39f9f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:06.836630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f43f-b845-4f72-ad47-34e9fae39f9f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:06.836943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f43f-b845-4f72-ad47-34e9fae39f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:06.917311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c502f43f-b845-4f72-ad47-34e9fae39f9f None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:06.918538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c502f43f-b845-4f72-ad47-34e9fae39f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:06.960631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:07.050456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 678/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Aug 8 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:07.058545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:07.060080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:07.250134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7c13-f36b-4c26-9c65-b690acd91bfb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:07.274568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:07.394238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:07.395252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:07.395714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:07.396165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:07.399119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:07.513111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:07.514945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394ed0b-24f8-4318-b29c-75655125522b service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:07.541166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 690/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:08.627390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e777a-cd70-447b-af46-6bbf1a9fc064 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.627929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e777a-cd70-447b-af46-6bbf1a9fc064 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.627929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e777a-cd70-447b-af46-6bbf1a9fc064 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.629464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 679/1369] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:08.634355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bf3d-d9ca-4b02-a4d0-260a4694b448 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.634764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bf3d-d9ca-4b02-a4d0-260a4694b448 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.634959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bf3d-d9ca-4b02-a4d0-260a4694b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.668267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:08.706156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6505bf3d-d9ca-4b02-a4d0-260a4694b448 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:08.707509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6505bf3d-d9ca-4b02-a4d0-260a4694b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:08.828859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 691/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:09.168337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.168599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.168897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.171486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 680/1371] 10.222.0.26 () {54 vars in 964 bytes} [Mon Aug 8 02:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:09.176241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f950d-7245-4510-8434-787a7a95242e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.176527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f950d-7245-4510-8434-787a7a95242e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.176826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f950d-7245-4510-8434-787a7a95242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.257697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc7f950d-7245-4510-8434-787a7a95242e None None] MFA Rules not processed for user `95fe28df0f1e4f9ca978a912bbffe4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:09.258906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc7f950d-7245-4510-8434-787a7a95242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:09.308955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.343661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 692/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Aug 8 02:09:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:09.352085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.353597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:09.474761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9d04-71af-42f9-b1a0-231d65b130fd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.642187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.679508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.680204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.680390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.680937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.682288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:09.709039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651429-0d8b-4bd7-9218-eca5187dbba0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.709528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651429-0d8b-4bd7-9218-eca5187dbba0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.709528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651429-0d8b-4bd7-9218-eca5187dbba0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.710988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 693/1373] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:09.715641 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f590-9411-4c7c-b419-3094c71dba38 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.716001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f590-9411-4c7c-b419-3094c71dba38 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.716366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f590-9411-4c7c-b419-3094c71dba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.795885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0800f590-9411-4c7c-b419-3094c71dba38 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:09.797014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0800f590-9411-4c7c-b419-3094c71dba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:09.803232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.804687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.827501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 681/1374] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:09.932829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 694/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:09:09.976495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.977717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:10.048140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:10.080027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57804-b0a4-4f2b-add0-128b97c59124 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:10.196437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:10.196983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:10.197252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:10.197512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:10.199089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:10.294164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:10.305211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:10.306816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5bc4-abac-47b0-a019-68066fff2d40 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:10.325658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 682/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:12.396511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.397412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.397842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.399371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 695/1377] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:12.405554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0836d6-b03a-41bc-961a-63278330ab90 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.406391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0836d6-b03a-41bc-961a-63278330ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.406853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0836d6-b03a-41bc-961a-63278330ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.479365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9d0836d6-b03a-41bc-961a-63278330ab90 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:12.480463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d0836d6-b03a-41bc-961a-63278330ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:12.577229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 683/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:12.621205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:12.622738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:12.681949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:12.780257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47dde-9727-4491-b339-710a1594e337 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:12.920218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:12.921363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.921646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.921919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.923517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:12.935097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:13.012412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.014062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad955b-317f-4e13-b5b1-c354ac62ba13 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.031624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 696/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:15.112157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:15.112845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:15.112974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:15.114745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 684/1380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:15.120755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e03-f342-4d37-872d-196e1350b77e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:15.121293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e03-f342-4d37-872d-196e1350b77e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:15.121293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e03-f342-4d37-872d-196e1350b77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:15.197834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e1785e03-f342-4d37-872d-196e1350b77e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:15.199025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e1785e03-f342-4d37-872d-196e1350b77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:15.290165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:15.303874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 697/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:15.353496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:15.355405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:15.434599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:15.524745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817599b5-22e7-4596-96dc-4ae481d7f842 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:15.648163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:15.648813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:15.649088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:15.649345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:15.650923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:15.674449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:15.750168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:15.751756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfeed5-8d7a-48cc-8fb9-8ab0fc6fccd2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:15.770807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 685/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:17.987213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.987778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.987778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.989157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 698/1383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:17.994519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4c13-60e1-4bc5-a2be-c16d46d9399f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.994931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4c13-60e1-4bc5-a2be-c16d46d9399f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.995047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4c13-60e1-4bc5-a2be-c16d46d9399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:18.064368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-925e4c13-60e1-4bc5-a2be-c16d46d9399f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:18.065650 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-925e4c13-60e1-4bc5-a2be-c16d46d9399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:18.177177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:18.180790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 686/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:09:18.224971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:18.226554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:18.378668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93c8c-13b6-4f4c-a588-c269d1091e8e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:18.450913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:18.505795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:18.506415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:18.506697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:18.506972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:18.508594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:18.602732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:18.604339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab9f44-843b-49a3-8bda-0c4c97bb0f55 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:18.623685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 699/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:20.671648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.672183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.672183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.673555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 687/1386] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:20.679380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150d1c3-3e7c-485f-9172-7d47710d165a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.679833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150d1c3-3e7c-485f-9172-7d47710d165a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.680219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150d1c3-3e7c-485f-9172-7d47710d165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.753149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7150d1c3-3e7c-485f-9172-7d47710d165a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:20.754360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7150d1c3-3e7c-485f-9172-7d47710d165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:20.783195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:20.862521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 700/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:20.908775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:20.910931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:21.080158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdc36-04e1-47f4-a619-ebdffc7b6b3e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:21.156111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:21.204010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:21.204620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:21.204916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:21.205183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:21.207077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:21.302808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:21.304418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabffc9-4027-4218-b86e-7e409d8678cc service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:21.324188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 688/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:23.930585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:23.931163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:23.931163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:23.932478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 701/1389] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:23.937951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04724c-4587-419a-8e40-4cf62f99f84c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:23.938351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04724c-4587-419a-8e40-4cf62f99f84c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:23.938617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04724c-4587-419a-8e40-4cf62f99f84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:24.004368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1c04724c-4587-419a-8e40-4cf62f99f84c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:24.005598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c04724c-4587-419a-8e40-4cf62f99f84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:24.044367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:24.106886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 689/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:24.151013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:24.152537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:24.298317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc252f96-ca4b-405a-bd45-f09bd676917c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:24.307158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:24.413669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:24.414284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:24.414559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:24.414827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:24.416434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:24.512321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:24.514557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed80f8-39f2-4b7c-a8dd-09e4ce0e7725 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:24.538357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 702/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:24.928456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796691-5baa-4769-b9d9-bd5a825da760 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:24.928784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796691-5baa-4769-b9d9-bd5a825da760 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:24.929056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796691-5baa-4769-b9d9-bd5a825da760 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:24.930436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 690/1392] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:24.935682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eba8f8-25db-4c2d-92d5-fd19ab5be663 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:24.936877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eba8f8-25db-4c2d-92d5-fd19ab5be663 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:24.936877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eba8f8-25db-4c2d-92d5-fd19ab5be663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:24.953070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.004825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-75eba8f8-25db-4c2d-92d5-fd19ab5be663 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:25.006034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-75eba8f8-25db-4c2d-92d5-fd19ab5be663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:25.106196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 703/1393] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:25.162917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.163368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.163466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.164868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 691/1394] 10.222.0.26 () {54 vars in 966 bytes} [Mon Aug 8 02:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:25.169803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a6a-1f67-4207-a95c-72563966034f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.170157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a6a-1f67-4207-a95c-72563966034f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.170638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a6a-1f67-4207-a95c-72563966034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.249421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-03c84a6a-1f67-4207-a95c-72563966034f None None] MFA Rules not processed for user `1ac10759b62640d08ddbd86d1972b54f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:25.250887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-03c84a6a-1f67-4207-a95c-72563966034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:25.292966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.345803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 704/1395] 10.222.0.26 () {58 vars in 1063 bytes} [Mon Aug 8 02:09:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:25.353413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:25.355027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:25.464352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914b402-f697-4179-ac7b-2c31339d470e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:25.526136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.538767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:25.539369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.539638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.539903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.541576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:25.652565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:25.654033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b961cd-e109-47a0-a953-4f6f993324a6 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:25.673519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 692/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:26.410025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746e6e-4462-42fb-8dc7-51b8d3027bc5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.410509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746e6e-4462-42fb-8dc7-51b8d3027bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.410598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746e6e-4462-42fb-8dc7-51b8d3027bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.487524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-08746e6e-4462-42fb-8dc7-51b8d3027bc5 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:26.488797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-08746e6e-4462-42fb-8dc7-51b8d3027bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:26.578339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 705/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:09:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:26.596904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d2b4-92a8-4044-912d-cb6a70f9c573 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.596904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d2b4-92a8-4044-912d-cb6a70f9c573 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.596904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d2b4-92a8-4044-912d-cb6a70f9c573 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.598730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 693/1398] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:26.604214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.604501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.604805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.622479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7d612-827d-49dc-a310-63c2c620a13e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.622764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7d612-827d-49dc-a310-63c2c620a13e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.623040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7d612-827d-49dc-a310-63c2c620a13e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.625149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 694/1399] 10.222.0.26 () {54 vars in 943 bytes} [Mon Aug 8 02:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:09:26.631958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.632310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.632668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.672224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:26.675065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:26.676896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:26.712892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] MFA Rules not processed for user `30ea9dc686de47a3a860483a746025ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:26.714221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:26.751410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:26.776322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 706/1400] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:26.822066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:26.823274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:26.826230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 695/1401] 10.222.0.26 () {58 vars in 1040 bytes} [Mon Aug 8 02:09:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:09:26.836180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:26.846367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12b4c-9290-49a3-ba16-eedec5183a8b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:26.940040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ca706-63e6-4ee9-b628-39262687b909 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:26.950663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:26.951263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:26.952101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:26.952448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:26.954119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:26.958618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:26.996977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:27.042131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:27.043718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d77f6-d4d7-4e61-9d0a-3fcdb3f45bde service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:27.051827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 696/1402] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:09:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:09:27.058317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:27.058838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:27.059122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:27.059397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:27.061217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:27.178202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:27.179830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d186a2-d615-4ac0-b750-ddafa0c0f090 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:27.204365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 707/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:29.275369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:29.275958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:29.275958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:29.277416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 697/1404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:29.282442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805764-f04a-4281-a625-ae0fd8e3df13 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:29.282884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805764-f04a-4281-a625-ae0fd8e3df13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:29.282981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805764-f04a-4281-a625-ae0fd8e3df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:29.315815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:29.360268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2805764-f04a-4281-a625-ae0fd8e3df13 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:29.361524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2805764-f04a-4281-a625-ae0fd8e3df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:29.598185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 708/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:29.642646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:29.644166 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:29.810257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200784a-f5ca-4cab-8bc4-5d061dc2f3a8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:29.854296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:29.943930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:29.944540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:29.944842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:29.945111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:29.946718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:30.054682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:30.056282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301684d3-1a8e-44d9-af8b-f8cb9b8dc1a0 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:30.078268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 698/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:32.266443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:32.267049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:32.267049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:32.268298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 709/1407] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:32.273503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acfd5d-659d-40d3-952e-15addc570a03 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:32.273961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acfd5d-659d-40d3-952e-15addc570a03 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:32.274060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acfd5d-659d-40d3-952e-15addc570a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:32.326772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:32.347699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-69acfd5d-659d-40d3-952e-15addc570a03 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:32.349223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69acfd5d-659d-40d3-952e-15addc570a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:32.463790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 699/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:32.510544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:32.512141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:32.641854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:32.701424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca58ba1-1577-4fad-920e-336107464f93 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:32.833177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:32.833786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:32.834060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:32.834327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:32.835931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:32.902755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:32.932857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:32.934972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83cf89-949f-4b20-a831-74ae644a9f8c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:32.954328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 710/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:42.461967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=48 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:42.952098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=17 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:49.333340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0f99-e36d-4642-bea8-8f0242075939 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:49.333917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0f99-e36d-4642-bea8-8f0242075939 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:49.333917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0f99-e36d-4642-bea8-8f0242075939 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:49.335216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 700/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Aug 8 02:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:49.340246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9cfc4-0a46-4622-be90-9b7ddcab0347 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:49.340667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9cfc4-0a46-4622-be90-9b7ddcab0347 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:49.340847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9cfc4-0a46-4622-be90-9b7ddcab0347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:49.417386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-daf9cfc4-0a46-4622-be90-9b7ddcab0347 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:49.418611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-daf9cfc4-0a46-4622-be90-9b7ddcab0347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:49.524411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 711/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 8 02:09:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:49.539196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8e39-412d-45b4-8ff4-71c059cad5cc None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:49.539578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8e39-412d-45b4-8ff4-71c059cad5cc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:49.539842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8e39-412d-45b4-8ff4-71c059cad5cc None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:49.541256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 701/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Aug 8 02:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:49.545736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ed17-684b-4173-8585-10c9c0a292c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:49.546025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ed17-684b-4173-8585-10c9c0a292c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:49.546300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641ed17-684b-4173-8585-10c9c0a292c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:49.617019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:49.619946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9641ed17-684b-4173-8585-10c9c0a292c2 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:49.621817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9641ed17-684b-4173-8585-10c9c0a292c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:49.736537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 712/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 8 02:09:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:52.186977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:52.187567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:52.187567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:52.188878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:09:52.194032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13db9-7d4a-49e6-8151-d53b50ca3b28 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:52.194444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13db9-7d4a-49e6-8151-d53b50ca3b28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:52.194876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13db9-7d4a-49e6-8151-d53b50ca3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:52.265625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e4a13db9-7d4a-49e6-8151-d53b50ca3b28 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:52.266847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e4a13db9-7d4a-49e6-8151-d53b50ca3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:52.320191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:52.361585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:09:52.405372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:52.406892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:52.552527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cfc59-324e-46d1-8e24-f6f36361a2d2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:52.623967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:52.663493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:52.664093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:52.664371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:52.664637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:52.666263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:52.761021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:52.762597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb03fe-60db-4f0e-804c-8c7acb881551 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:52.780728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 703/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:53.682300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:53.682837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:53.682837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:53.684115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:53.689153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8838e-6429-488d-a414-886062172dc4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:53.689587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8838e-6429-488d-a414-886062172dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:53.689693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8838e-6429-488d-a414-886062172dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:53.766269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-59f8838e-6429-488d-a414-886062172dc4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:53.767471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-59f8838e-6429-488d-a414-886062172dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:53.794028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:53.867049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:54.014989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:54.016445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:54.161544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e05f9-feaf-419a-a966-d0d98fa382f2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:54.200170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:54.273627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:54.274142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:54.274418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:54.274677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:54.276243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:54.364757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:54.366381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b23338-896f-4c23-ba53-8b1e4f348cbe service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:54.384495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 715/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:55.266229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:55.266819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:55.266819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:55.268125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:55.273200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705320-10f0-47ba-a83c-7dff0e11c5b1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:55.273609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705320-10f0-47ba-a83c-7dff0e11c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:55.273748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705320-10f0-47ba-a83c-7dff0e11c5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:55.327773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:55.349965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7c705320-10f0-47ba-a83c-7dff0e11c5b1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:55.351175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7c705320-10f0-47ba-a83c-7dff0e11c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:55.447367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:55.600921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:55.602234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:55.747596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96213861-4d8e-4d98-b6f7-9814dbf08450 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:55.760203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:55.862492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:55.863010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:55.863284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:55.863548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:55.865194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:55.953069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:55.954654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c7fa4-a807-4605-9652-8103cd010d6b service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:55.972911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 706/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:56.849381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:56.849897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:56.849897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:56.851237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:56.855998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985745-f296-4584-bd9c-c3039f67eff7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:56.856407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985745-f296-4584-bd9c-c3039f67eff7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:56.856530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985745-f296-4584-bd9c-c3039f67eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:56.877224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:56.933781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-61985745-f296-4584-bd9c-c3039f67eff7 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:56.934974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-61985745-f296-4584-bd9c-c3039f67eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:57.028108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:57.179270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:57.180821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:57.290432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:57.325348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a657d-2adf-483d-9072-59ea67f49b0c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:57.436003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:57.437133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:57.437392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:57.437665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:57.439249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:57.515855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:57.529773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:57.531451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4af789-ec9e-438d-91c7-d89ca28f9132 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:57.551256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 718/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:58.408130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:58.408706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:58.408706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:58.410001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:58.415244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4500-b60a-482b-8092-48e523b61159 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:58.415644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4500-b60a-482b-8092-48e523b61159 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:58.415792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4500-b60a-482b-8092-48e523b61159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:58.491489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8cfe4500-b60a-482b-8092-48e523b61159 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:58.492714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8cfe4500-b60a-482b-8092-48e523b61159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:58.586993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:09:58.737491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:58.738929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:58.827128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:58.889430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84bd31-72eb-433d-9deb-2b4f8733b198 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:59.002806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:59.003328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:59.003605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:59.003877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:59.005509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:59.052974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:59.094681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:59.096263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ad54c-ba14-4631-9cac-c86323850650 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:59.114283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 709/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:09:59.909851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:59.910425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:59.910425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:59.911726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:59.916620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8d1b-8ae8-438d-98f8-4d578dd3acc1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:59.917026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8d1b-8ae8-438d-98f8-4d578dd3acc1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:59.917200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8d1b-8ae8-438d-98f8-4d578dd3acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:59.994242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5add8d1b-8ae8-438d-98f8-4d578dd3acc1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:59.995442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5add8d1b-8ae8-438d-98f8-4d578dd3acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:00.090923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:00.243067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:00.244508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:00.293774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:00.391141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71d41-1d3b-47fe-a35f-1b49880152e4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:00.502894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:00.503420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:00.503723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:00.503991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:00.505612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:00.512404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:00.597949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:00.599902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b08b5-2b11-4f2d-974e-414dd0a7cc95 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:00.620732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 721/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:01.434083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:01.434600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:01.434712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:01.435978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:01.441090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fad2-d827-4f81-97ad-5ff9c77cee5c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:01.441546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fad2-d827-4f81-97ad-5ff9c77cee5c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:01.441652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fad2-d827-4f81-97ad-5ff9c77cee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:01.518762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fa45fad2-d827-4f81-97ad-5ff9c77cee5c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:01.519962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa45fad2-d827-4f81-97ad-5ff9c77cee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:01.586217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:01.616600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:01.766895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:01.768322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:01.786296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:01.915992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207098f-1024-4db2-bf3d-04f5c0419499 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:02.002641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:02.028972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:02.029661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:02.029985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:02.030258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:02.031852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:02.120987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:02.122576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb0b58-d820-42b3-98d2-3af65c9afe80 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:02.142804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 712/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:02.944592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:02.945220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:02.945220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:02.946521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:02.951725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008e1c-d043-4588-9a14-e53e8b38607a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:02.952142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008e1c-d043-4588-9a14-e53e8b38607a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:02.952274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008e1c-d043-4588-9a14-e53e8b38607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:03.028131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cc008e1c-d043-4588-9a14-e53e8b38607a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:03.029592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cc008e1c-d043-4588-9a14-e53e8b38607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:03.071183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:03.127718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:03.278288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:03.279769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:03.425423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a930-55b6-4c75-bc73-b39769c14bb1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:03.482875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:03.542975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:03.543502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:03.543776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:03.544041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:03.546349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:03.634190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:03.635766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b28db-71f5-4983-91fc-00764dedcfbc service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:03.653962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 724/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:04.457481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:04.457949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:04.458052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:04.459344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:04.464327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a9d5-ddec-4c89-a007-a6ccb3c82fd1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:04.464780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a9d5-ddec-4c89-a007-a6ccb3c82fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:04.464886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a9d5-ddec-4c89-a007-a6ccb3c82fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:04.541773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e339a9d5-ddec-4c89-a007-a6ccb3c82fd1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:04.543098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e339a9d5-ddec-4c89-a007-a6ccb3c82fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:04.546113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:04.642362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:04.796518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:04.797982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:04.942032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f915-58d5-4d7c-a7b2-7ab68ea05e63 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:04.968790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:05.055236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:05.055765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:05.056041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:05.056310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:05.057975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:05.145102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:05.146695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bf895-934d-4a2b-b1ac-007e80c054b1 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:05.165119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 715/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:07.083307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:07.083874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:07.083874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:07.085261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:07.090634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7d5-b94f-4aa4-b8da-b037aa4f1502 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:07.091085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7d5-b94f-4aa4-b8da-b037aa4f1502 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:07.091200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7d5-b94f-4aa4-b8da-b037aa4f1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:07.133764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:07.160285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-de69a7d5-b94f-4aa4-b8da-b037aa4f1502 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:07.161516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de69a7d5-b94f-4aa4-b8da-b037aa4f1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:07.261116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:07.300462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:07.302054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:07.405140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b3f9-bc55-498f-84a6-0dfbdd1051a2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:07.438018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:07.480533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:07.481160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:07.481437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:07.481700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:07.483293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:07.591351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:07.593427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2b00-1f44-43fa-9f76-d4940a1bec17 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:07.611116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 727/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:09.872671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:09.873835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:09.873835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:09.875158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:09.880316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5b876-08be-4a9c-9d5e-cb1deb3e81a3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:09.880758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5b876-08be-4a9c-9d5e-cb1deb3e81a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:09.880893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5b876-08be-4a9c-9d5e-cb1deb3e81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:09.946259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c5e5b876-08be-4a9c-9d5e-cb1deb3e81a3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:09.947463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5e5b876-08be-4a9c-9d5e-cb1deb3e81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:09.960472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:10.043889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:10.082155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:10.083718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:10.187726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a1e2f-1d1f-432c-ac31-769a66a89c82 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:10.199719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:10.261280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:10.261887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:10.262158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:10.262423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:10.264612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:10.371194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:10.372615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37855a7-9342-4ebf-8422-4e25310a9cda service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:10.392036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 718/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:12.679180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:12.679710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:12.679710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:12.681099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:12.686822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4312f-5efc-4eb1-984f-a301ddafdca0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:12.687242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4312f-5efc-4eb1-984f-a301ddafdca0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:12.687350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4312f-5efc-4eb1-984f-a301ddafdca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:12.738904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:12.757163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4ba4312f-5efc-4eb1-984f-a301ddafdca0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:12.758380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4ba4312f-5efc-4eb1-984f-a301ddafdca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:12.854834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:12.896197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:12.897802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:13.001459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5f25-f9a0-4e1e-aa8e-ab9436d1b9bf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:13.039866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:13.073917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:13.074518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:13.074792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:13.075059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:13.076689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:13.183579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:13.185052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef181d8-c871-474e-9e5e-dfa380d2758b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:13.203201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 730/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:15.344585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:15.345179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:15.345179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:15.346470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:15.352028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967eb6-fd09-4f17-875b-de516fbd3fe5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:15.352422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967eb6-fd09-4f17-875b-de516fbd3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:15.352606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967eb6-fd09-4f17-875b-de516fbd3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:15.421410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1967eb6-fd09-4f17-875b-de516fbd3fe5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:15.422606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1967eb6-fd09-4f17-875b-de516fbd3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:15.445340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:15.522255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:15.561209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:15.562737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:15.665874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c54ea-41db-47a0-becf-916e1f589e00 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:15.686442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:15.740915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:15.741503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:15.741806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:15.742078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:15.743662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:15.852554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:15.854027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8401d-b1b7-4631-821b-fbb11127d4e5 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:15.873308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 721/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:17.938498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:17.939039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:17.939039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:17.940436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:17.945888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e8e7-f7f9-4b16-b805-119308e96d84 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:17.946295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e8e7-f7f9-4b16-b805-119308e96d84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:17.946438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e8e7-f7f9-4b16-b805-119308e96d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:18.010654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:18.015218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e2d3e8e7-f7f9-4b16-b805-119308e96d84 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:18.016835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2d3e8e7-f7f9-4b16-b805-119308e96d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:18.113198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:18.152799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:18.155490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:18.259168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9449eab-3bcf-4966-b255-7b6442b73055 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:18.307730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:18.333949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:18.334547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:18.334820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:18.335083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:18.336736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:18.445156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:18.446593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b35b-0618-4513-8819-a684df5a109b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:18.464910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 733/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:20.494667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:20.495202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:20.495202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:20.496523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:20.501722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6eba0-8f08-4832-bf28-317b7bf9dc45 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:20.502174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6eba0-8f08-4832-bf28-317b7bf9dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:20.502279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6eba0-8f08-4832-bf28-317b7bf9dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:20.568755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cae6eba0-8f08-4832-bf28-317b7bf9dc45 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:20.569960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cae6eba0-8f08-4832-bf28-317b7bf9dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:20.598856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:20.667381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:20.706618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:20.708195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:20.810002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f852fe-9828-4db8-aaa8-45cc8354ca63 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:20.839173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:20.886078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:20.886680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:20.886958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:20.887246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:20.889508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:20.996788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:20.998748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdf99e-3cdc-48d8-9a5d-45b706e15426 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:21.016722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 724/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:23.172162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:23.172744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:23.172744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:23.174133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:23.179604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ee21-cc34-4001-b060-88b8f843e5d5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:23.180039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ee21-cc34-4001-b060-88b8f843e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:23.180136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ee21-cc34-4001-b060-88b8f843e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:23.245774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-63a6ee21-cc34-4001-b060-88b8f843e5d5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:23.246981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-63a6ee21-cc34-4001-b060-88b8f843e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:23.255793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:23.347671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:23.392389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:23.393942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:23.499373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c438a1-eb9a-4801-801c-f5e95cb93db0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:23.553015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:23.571235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:23.571832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:23.572106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:23.572371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:23.573972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:23.681420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:23.682764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b813d-f02e-421d-82e5-557955049faf service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:23.700424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 736/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:25.731269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:25.731799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:25.731799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:25.733905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:25.739011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478a29-e4a9-4022-8eda-3c4a79a00fba None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:25.739435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478a29-e4a9-4022-8eda-3c4a79a00fba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:25.739560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478a29-e4a9-4022-8eda-3c4a79a00fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:25.804655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ca478a29-e4a9-4022-8eda-3c4a79a00fba None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:25.805900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ca478a29-e4a9-4022-8eda-3c4a79a00fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:25.844939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:25.904217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:25.941542 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:25.943068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:26.045759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74082-4df4-47e9-92d5-70580cfd518f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:26.082231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:26.118189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:26.118792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:26.119114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:26.119521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:26.121097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:26.229187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:26.230619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65d1af-6e44-4390-bf93-c23722f7756f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:26.249890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 727/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:28.263864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:28.264430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:28.264430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:28.265797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:28.270957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc488-7d35-4413-bf4e-cc073667e8b1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:28.271398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc488-7d35-4413-bf4e-cc073667e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:28.271505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc488-7d35-4413-bf4e-cc073667e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:28.335886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8b5fc488-7d35-4413-bf4e-cc073667e8b1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:28.337159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b5fc488-7d35-4413-bf4e-cc073667e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:28.355531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:28.439702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:28.476966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:28.478507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:28.581701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83aa20-f6c0-4f05-a093-2562bacfa948 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:28.647643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:28.655944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:28.656571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:28.656875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:28.657266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:28.658853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:28.766677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:28.768098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d62ca0-6ed0-4196-b3fa-3daeca362844 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:28.786207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 739/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:30.820389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:30.820927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:30.820927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:30.822294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:30.828040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffdc9-953e-442e-9137-033097066c17 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:30.828474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffdc9-953e-442e-9137-033097066c17 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:30.828608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffdc9-953e-442e-9137-033097066c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:30.898392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b9ffdc9-953e-442e-9137-033097066c17 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:30.899612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b9ffdc9-953e-442e-9137-033097066c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:30.947966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:30.996712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:31.034436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:31.035953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:31.138531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc16f-46ae-47db-96ea-5f877b6229c4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:31.186224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:31.212778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:31.213383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:31.213659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:31.213926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:31.215519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:31.323986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:31.325454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef82782-dcad-402f-8b54-4004ddeb512f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:31.344446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 730/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:40.994925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=22 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:41.342614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=66 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:50.765013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c212b0-0b22-47e2-8216-9a7d4f32c395 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:50.765572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c212b0-0b22-47e2-8216-9a7d4f32c395 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:50.765572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c212b0-0b22-47e2-8216-9a7d4f32c395 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:50.766915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 741/1471] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:50.772147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bbb5-ca91-424e-831b-7db25665e0b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:50.772565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bbb5-ca91-424e-831b-7db25665e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:50.772692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7bbb5-ca91-424e-831b-7db25665e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:50.839003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2dd7bbb5-ca91-424e-831b-7db25665e0b0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:50.840222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2dd7bbb5-ca91-424e-831b-7db25665e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:50.939214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 731/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:51.026473 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:51.026757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:51.027030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:51.028392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 742/1473] 10.222.0.26 () {54 vars in 966 bytes} [Mon Aug 8 02:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:51.033236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a46-dabb-4ecf-ba5d-6ead2ce417fd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:51.033516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a46-dabb-4ecf-ba5d-6ead2ce417fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:51.033780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a46-dabb-4ecf-ba5d-6ead2ce417fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:51.111436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1dcf1a46-dabb-4ecf-ba5d-6ead2ce417fd None None] MFA Rules not processed for user `1ac10759b62640d08ddbd86d1972b54f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:51.112630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1dcf1a46-dabb-4ecf-ba5d-6ead2ce417fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:51.134695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:51.190907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 732/1474] 10.222.0.26 () {58 vars in 1063 bytes} [Mon Aug 8 02:10:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:51.198391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:51.199893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:51.303821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e74c9a-92c4-45cd-ac45-7674f70b73fa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:51.376656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:51.377278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:51.377826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:51.378103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:51.379958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:51.434472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:51.490401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:51.491837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e8739-bb2f-4fd7-b7bc-3cb7b53ef1f5 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:51.509952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 743/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:53.622325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:53.622890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:53.622988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:53.624349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 733/1476] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:53.629676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29ffa-aa6c-45cc-9be9-98ceb4c7ffc3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:53.630097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29ffa-aa6c-45cc-9be9-98ceb4c7ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:53.630222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29ffa-aa6c-45cc-9be9-98ceb4c7ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:53.695103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d9e29ffa-aa6c-45cc-9be9-98ceb4c7ffc3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:53.696243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9e29ffa-aa6c-45cc-9be9-98ceb4c7ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:53.791262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 744/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:53.814921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:53.816450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:53.940947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385279-ee4c-4779-ac70-e6c94885e6cf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:53.989581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:54.035111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:54.035710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:54.035980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:54.036243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:54.036903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:54.038607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:10:54.038607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:10:54.038607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:10:54.039737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4057f-5f8c-460b-959a-15b77821a98c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:54.057816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 734/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Aug 8 02:10:53 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:10:56.058182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:56.058759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:56.058759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:56.060082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 745/1479] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:56.065367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef85d-a1d4-48d6-ba69-4b4284fc6df5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:56.065763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef85d-a1d4-48d6-ba69-4b4284fc6df5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:56.065927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef85d-a1d4-48d6-ba69-4b4284fc6df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:56.131927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c36ef85d-a1d4-48d6-ba69-4b4284fc6df5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:56.133240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c36ef85d-a1d4-48d6-ba69-4b4284fc6df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:56.231357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 735/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:56.275010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:56.276626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:56.287299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:56.422815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07438938-4246-4ec7-8413-5911bbfecb11 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:56.506889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:56.542085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:56.542715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:56.543013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:56.543278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:56.545028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:56.634410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:56.636007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5067ac-bdb0-4430-88a8-aafb8705de95 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:56.654352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 746/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:10:58.827851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:58.828378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:58.828378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:58.829957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 736/1482] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:10:58.835170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842036-e61b-410a-96e8-63cb6e47a353 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:58.835622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842036-e61b-410a-96e8-63cb6e47a353 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:58.835721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842036-e61b-410a-96e8-63cb6e47a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:58.902850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-66842036-e61b-410a-96e8-63cb6e47a353 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:10:58.904798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-66842036-e61b-410a-96e8-63cb6e47a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:58.949719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:59.000886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 747/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:10:59.043805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:10:59.046064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:59.069623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:59.149135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948eb7a-8c8e-4043-b6a0-e51c7f701cdd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:10:59.222762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:10:59.223375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:10:59.223654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:10:59.223924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:10:59.225817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:10:59.299901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:10:59.334672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:10:59.336119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33626808-cb3d-4ca2-a26b-a74a2ac846ac service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:10:59.354668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 737/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:11:01.409621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:01.410204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:01.410204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:01.411568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 748/1485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:11:01.416731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ff63-00ad-41eb-9e13-a4b88185e098 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:01.417193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ff63-00ad-41eb-9e13-a4b88185e098 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:01.417301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ff63-00ad-41eb-9e13-a4b88185e098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:01.484304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4dc5ff63-00ad-41eb-9e13-a4b88185e098 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:11:01.485527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4dc5ff63-00ad-41eb-9e13-a4b88185e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:01.581158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 738/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:11:01.620136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:11:01.621729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:01.731239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2134630-8be4-43bb-a7ab-3779f85a4695 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:11:01.802976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:01.804956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:11:01.805593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:01.806055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:01.806489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:01.808341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:01.921840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:11:01.923275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c750eaa-798c-4ffd-a6fe-a315bcca66b4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:11:01.941584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 749/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:11:04.057280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:04.057888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:04.057888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:04.059152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 739/1488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:11:04.065269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39f6d-9806-4c76-8f56-814a23b029c3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:04.065717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39f6d-9806-4c76-8f56-814a23b029c3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:04.065827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39f6d-9806-4c76-8f56-814a23b029c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:04.131204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4cf39f6d-9806-4c76-8f56-814a23b029c3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:11:04.132410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4cf39f6d-9806-4c76-8f56-814a23b029c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:04.184123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:04.229525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 750/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:11:04.270897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:11:04.272487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:04.308503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:04.378171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa48ac-7496-4e6f-90c9-f24c4a1d14ff None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:11:04.452596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:11:04.453289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:04.453562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:04.453828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:04.455407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:04.534465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:04.565122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:11:04.566563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109835-8278-496e-bb14-89b0e9f542e8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:11:04.584663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 740/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:11:06.787442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:06.787951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:06.787951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:06.789288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 751/1491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Aug 8 02:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:11:06.794880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c593e-42ef-489d-a6c6-a9641e941bc4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:06.795341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c593e-42ef-489d-a6c6-a9641e941bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:06.795451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c593e-42ef-489d-a6c6-a9641e941bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:06.861045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c30c593e-42ef-489d-a6c6-a9641e941bc4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:11:06.862230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c30c593e-42ef-489d-a6c6-a9641e941bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:06.957299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 741/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Aug 8 02:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:11:06.996923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:11:06.998601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:07.103974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4b1e-121c-4560-9429-2ec8ac8a62d3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:11:07.176717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:11:07.177320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:11:07.177601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:11:07.177867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:11:07.179457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:11:07.189150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:07.291183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:11:07.292624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5994a4-87a9-4ac6-9d26-8e5b9868b54a service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:11:07.310866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 752/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:11:16.955496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=82 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:11:17.308045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=50 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:23.846675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:23.847234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:23.847234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:23.923366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:12:23.924569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.025355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 742/1494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:12:24.033561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.034064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.034166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.108774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:12:24.109905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.204811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 753/1495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:12:24.209461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:24.210657 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.223283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65107b1-6710-4fa1-be76-ccbcd001dbf0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:24.284676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:24.318325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:24.318927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.319203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.319471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.320109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:12:24.320407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:24.321452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:24.321452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:12:24.321452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:12:24.322327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:24.334040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 743/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:12:24.343202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:24.352583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe80c-30e0-44d6-91e0-ce47d8d2fd78 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:24.413766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:24.447479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:24.448083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.448359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.448626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.449263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:24.451563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:24.451563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:12:24.451563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:12:24.452775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:24.508715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 754/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:12:24 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:12:24.513581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:24.515116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.548731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840112-a166-454f-822f-acc528a60a46 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:24.642013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:24.642620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.642897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.643170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.643786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:24.644840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:24.644840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:12:24.644840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:12:24.646057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:24.687803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 744/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:12:24 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:12:24.691899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:24.693588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.755914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95a43-2999-431e-a216-efc00b6c227b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:24.836544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:24.847938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:24.848536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.848835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.849118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.849738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:24.850735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:24.850735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:12:24.850735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:12:24.851873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:24.864563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 755/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:12:24.868555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:24.870179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:24.881881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e639-8fc0-44b1-a9d4-2bc63d04dbea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:24.906959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:24.978411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:24.978941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:24.979221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:24.979492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:24.980133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:24.981782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:24.981782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:12:24.981782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:12:24.982708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259399-8a11-4823-90e4-89eff47e93ac admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:24.994840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 745/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:12:24.999134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:25.000689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.033959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd215f-4481-422a-8e5b-eca9d0026163 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:25.127821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:25.128484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.128806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.129077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] PATH_INFO: `/v3/projects/d4e182a0358b48d0bb2452c07764ff7e/users/8d6afec30e0b481f9ac1181b91fbac14/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.151105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e182a0358b48d0bb2452c07764ff7e, user_id=8d6afec30e0b481f9ac1181b91fbac14, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:25.152125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:25.152125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:12:25.152125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:12:25.154736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f339545-317c-460d-ad45-3d679cf210df admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:25.177813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 756/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:12:24 2022] PUT /identity/v3/projects/d4e182a0358b48d0bb2452c07764ff7e/users/8d6afec30e0b481f9ac1181b91fbac14/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:12:25.190044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3316c2-802a-4cb8-80da-0dae887d94de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.190356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3316c2-802a-4cb8-80da-0dae887d94de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.190631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3316c2-802a-4cb8-80da-0dae887d94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.248510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3c3316c2-802a-4cb8-80da-0dae887d94de None None] MFA Rules not processed for user `8d6afec30e0b481f9ac1181b91fbac14`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:12:25.249659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c3316c2-802a-4cb8-80da-0dae887d94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.325966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 746/1502] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:12:25.339310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.339600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.339872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.342203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 757/1503] 10.222.0.26 () {54 vars in 964 bytes} [Mon Aug 8 02:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:12:25.346836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abbc3-76cc-4821-8717-ac88b23dc917 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.347127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abbc3-76cc-4821-8717-ac88b23dc917 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.347402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abbc3-76cc-4821-8717-ac88b23dc917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.378533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:25.423514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ae0abbc3-76cc-4821-8717-ac88b23dc917 None None] MFA Rules not processed for user `95fe28df0f1e4f9ca978a912bbffe4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:12:25.424756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ae0abbc3-76cc-4821-8717-ac88b23dc917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.501049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 747/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Aug 8 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:12:25.508881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:25.510413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.560712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:25.615029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fdd48-ee49-4f91-a967-c10d56a4af00 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:25.686524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:25.687124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.687402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.687664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.689272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.788324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:25.789705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:25.793158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:25.808243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 758/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:12:25.853178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b8e7-c919-46be-ae7a-6a7d955a2ef3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:25.853469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b8e7-c919-46be-ae7a-6a7d955a2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:25.853743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b8e7-c919-46be-ae7a-6a7d955a2ef3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:25.854996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 748/1506] 10.222.0.26 () {52 vars in 830 bytes} [Mon Aug 8 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:12:25.859093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:25.860279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:25.958739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13311f8-ac68-4c9a-82c7-6abac37bd371 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:26.051349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:26.052005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:26.052160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:26.052436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] PATH_INFO: `/v3/users/8d6afec30e0b481f9ac1181b91fbac14` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:26.065092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6afec30e0b481f9ac1181b91fbac14)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:26.066109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:26.066109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:12:26.066109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:12:26.067321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:26.076962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:26.134497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6afec30e0b481f9ac1181b91fbac14'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:26.144332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6afec30e0b481f9ac1181b91fbac14'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:26.144876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6afec30e0b481f9ac1181b91fbac14'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:26.145311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6afec30e0b481f9ac1181b91fbac14'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:26.159488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6afec30e0b481f9ac1181b91fbac14'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:26.188793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 759/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:12:25 2022] DELETE /identity/v3/users/8d6afec30e0b481f9ac1181b91fbac14 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:12:26.193132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:26.193590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:26.193696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:26.250700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:12:26.251887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:26.325139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:26.338117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 749/1508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:12:26.348297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:26.349570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:26.454845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b84d3a-e73c-4e74-8481-0e4aa9eab676 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:26.509967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:26.531853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:26.532468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:26.532805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:26.533078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:26.534684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:26.643825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:26.645295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f9a7-0f6e-47c3-b490-f7c791e4e804 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:26.663665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 760/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:12:27.021680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:12:27.022969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:12:27.034336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad860c-8be6-498d-b664-55871e470bdb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:12:27.133258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:12:27.133884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:12:27.134156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:12:27.134421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] PATH_INFO: `/v3/projects/d4e182a0358b48d0bb2452c07764ff7e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:12:27.144865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e182a0358b48d0bb2452c07764ff7e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:12:27.145943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:12:27.145943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:12:27.145943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:12:27.147088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:12:27.203954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e182a0358b48d0bb2452c07764ff7e', 'request_id': 'req-eb0779eb-312b-4895-92ea-485095be5ec0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:27.209882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e182a0358b48d0bb2452c07764ff7e', 'request_id': 'req-eb0779eb-312b-4895-92ea-485095be5ec0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:27.218962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e182a0358b48d0bb2452c07764ff7e', 'request_id': 'req-eb0779eb-312b-4895-92ea-485095be5ec0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:27.249757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] The token cache is being invalidate because project d4e182a0358b48d0bb2452c07764ff7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:12:27.250049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:27.250575 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eb0779eb-312b-4895-92ea-485095be5ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:12:27.251895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 750/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:12:27 2022] DELETE /identity/v3/projects/d4e182a0358b48d0bb2452c07764ff7e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:12:36.661429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=62 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:12:37.246874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.403074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.403634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.403634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.404906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:02.409855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f7b6c-0bb1-41b1-a013-2847bf1ee1bc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.410322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f7b6c-0bb1-41b1-a013-2847bf1ee1bc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.410426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f7b6c-0bb1-41b1-a013-2847bf1ee1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.492438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d83f7b6c-0bb1-41b1-a013-2847bf1ee1bc None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:02.493671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d83f7b6c-0bb1-41b1-a013-2847bf1ee1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:02.596478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:02.753441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.755582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:02.875062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fac0-029f-4e89-89bf-78b92ba00e79 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.882689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.883297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.883573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.883838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.892673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.894289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cb025-61f5-4226-8037-e1ff9f04e485 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.905026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 762/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:03.741029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39d69-0caa-4119-a055-d438568a7b66 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.741760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39d69-0caa-4119-a055-d438568a7b66 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.741760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39d69-0caa-4119-a055-d438568a7b66 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.742810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:03.747691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7623-dd7c-42e3-a178-02a0c8c57ff0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.748130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7623-dd7c-42e3-a178-02a0c8c57ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.748242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7623-dd7c-42e3-a178-02a0c8c57ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.767417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ebdd7623-dd7c-42e3-a178-02a0c8c57ff0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:03.768615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebdd7623-dd7c-42e3-a178-02a0c8c57ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:03.776579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:03.928519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae39d69-0caa-4119-a055-d438568a7b66 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:03.942648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae39d69-0caa-4119-a055-d438568a7b66 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:03.948072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:03.948689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.948974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.949248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.957169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:03.958748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e14a1-7920-4e34-8112-ef56807a238f service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:03.968539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 753/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:04.434433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888452-8c7f-49f9-b865-8f5721ae38ed None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.434719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888452-8c7f-49f9-b865-8f5721ae38ed None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.434995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888452-8c7f-49f9-b865-8f5721ae38ed None None] PATH_INFO: `/v3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.436321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 764/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Aug 8 02:20:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:04.443023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bb37-4f6f-43a3-9fce-f665d1d2cab0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.443806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bb37-4f6f-43a3-9fce-f665d1d2cab0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.444103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796bb37-4f6f-43a3-9fce-f665d1d2cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.501451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1796bb37-4f6f-43a3-9fce-f665d1d2cab0 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:04.502649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1796bb37-4f6f-43a3-9fce-f665d1d2cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:04.519713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:04.574304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 754/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Aug 8 02:20:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:13.762711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=56 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:13.855042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15b4c3-45d3-480e-a3eb-50f83039bbc3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.855323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15b4c3-45d3-480e-a3eb-50f83039bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.855597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15b4c3-45d3-480e-a3eb-50f83039bbc3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.856979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 765/1519] 10.222.0.26 () {54 vars in 961 bytes} [Mon Aug 8 02:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:13.862211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2f3c-ef48-49af-906e-b7669d617911 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.862660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2f3c-ef48-49af-906e-b7669d617911 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.862760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2f3c-ef48-49af-906e-b7669d617911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.883560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9ebc2f3c-ef48-49af-906e-b7669d617911 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:13.884776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9ebc2f3c-ef48-49af-906e-b7669d617911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:13.893135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 755/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Aug 8 02:20:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:13.900758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15b4c3-45d3-480e-a3eb-50f83039bbc3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:13.914690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15b4c3-45d3-480e-a3eb-50f83039bbc3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:13.919619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:13.920205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.920524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.920818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.929623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:13.931190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa55b3-1956-4f12-a853-466f4359a013 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:13.940632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 766/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:20:15.202445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64273412-2b92-4a13-b86f-f98cfd2abb71 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.203019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64273412-2b92-4a13-b86f-f98cfd2abb71 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.203019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64273412-2b92-4a13-b86f-f98cfd2abb71 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.204332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:15.209128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c708-8f3d-4984-a137-883751af13be None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.209525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c708-8f3d-4984-a137-883751af13be None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.209708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c708-8f3d-4984-a137-883751af13be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.229076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5ce6c708-8f3d-4984-a137-883751af13be None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:15.230278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ce6c708-8f3d-4984-a137-883751af13be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:15.241830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:15.394902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64273412-2b92-4a13-b86f-f98cfd2abb71 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.409517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64273412-2b92-4a13-b86f-f98cfd2abb71 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.415706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.416306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.416580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.416874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.428078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.428078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4ce4-cd6f-40ea-a35c-559c713d6ef1 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.436932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 757/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:16.257838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754767d7-0a59-4310-93a7-3795f810bc61 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.258427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754767d7-0a59-4310-93a7-3795f810bc61 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.258427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754767d7-0a59-4310-93a7-3795f810bc61 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.259748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:16.264416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d06-c14a-4e14-828a-c20cde8c0768 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.264869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d06-c14a-4e14-828a-c20cde8c0768 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.264987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d06-c14a-4e14-828a-c20cde8c0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.283828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1c5e8d06-c14a-4e14-828a-c20cde8c0768 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:16.285052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c5e8d06-c14a-4e14-828a-c20cde8c0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:16.293362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:16.445141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754767d7-0a59-4310-93a7-3795f810bc61 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.459101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754767d7-0a59-4310-93a7-3795f810bc61 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.465099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.465695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.465973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.466242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.475778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.478165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9b3fa-3165-42f0-85d0-bb351cbffc6f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.488184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 769/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:20.548741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.549263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.549263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.550553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:20.556128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6471f3-ef48-45ec-8e3a-91c02443d108 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.556571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6471f3-ef48-45ec-8e3a-91c02443d108 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.556697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6471f3-ef48-45ec-8e3a-91c02443d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.576210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1c6471f3-ef48-45ec-8e3a-91c02443d108 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:20.577437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1c6471f3-ef48-45ec-8e3a-91c02443d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:20.585827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:20.658415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.660147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:20.737618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d92963-3dc6-4a31-86a7-978eb41cdaee None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.741149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.741740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.742019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.742292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.752090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.753694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf78d-da4d-40e8-9389-83b18a0f53bd service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.763613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 760/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:22.753512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec3b-9159-4aea-9ca8-289c86f80c81 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.754042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec3b-9159-4aea-9ca8-289c86f80c81 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.754042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec3b-9159-4aea-9ca8-289c86f80c81 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.755334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:22.761385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9c29-a850-4ebc-8744-b85edcb4262a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.761815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9c29-a850-4ebc-8744-b85edcb4262a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.761923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9c29-a850-4ebc-8744-b85edcb4262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.781238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a07b9c29-a850-4ebc-8744-b85edcb4262a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:22.782459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a07b9c29-a850-4ebc-8744-b85edcb4262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:22.790214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:22.826604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cec3b-9159-4aea-9ca8-289c86f80c81 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:22.837514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cec3b-9159-4aea-9ca8-289c86f80c81 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:22.841041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:22.841631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.841906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.842173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.851027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:22.852756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8926d3f-a9ee-468f-9925-2ccc181e22fd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:22.862009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 772/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:26.357582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.358176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.358176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.359448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:26.364716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27cdd-6533-488e-b0cb-09be9b0cf60a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.365155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27cdd-6533-488e-b0cb-09be9b0cf60a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.365255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27cdd-6533-488e-b0cb-09be9b0cf60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.385769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1db27cdd-6533-488e-b0cb-09be9b0cf60a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:26.386959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1db27cdd-6533-488e-b0cb-09be9b0cf60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:26.394672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:26.699546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:26.701252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:26.765526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:26.779230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679bbd2-9e32-43ce-af4d-d9c97ab79e01 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:26.782863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:26.783468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.783745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.784015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.793447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:26.794876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076187-9d6f-4404-86e3-a8bc9b05ef1c service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:26.804876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 763/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:28.802594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.803726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.803726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.804992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:28.810236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525543-abd6-421c-b388-25d718c99e53 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.810636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525543-abd6-421c-b388-25d718c99e53 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.810809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525543-abd6-421c-b388-25d718c99e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.830775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-63525543-abd6-421c-b388-25d718c99e53 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:28.831974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-63525543-abd6-421c-b388-25d718c99e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:28.839959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:29.144174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.145932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:29.159785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55485e14-a18a-4aa3-a98e-ed3c3982414d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.163319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.163916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.164198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.164470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.174011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.175435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a88a6-c98b-4255-8e04-c585e0c27714 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.184870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 775/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:38.826143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=11 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:39.180702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=33 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:58.796638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28758-76a0-44ba-9ab0-f7ea15aa4277 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.802206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28758-76a0-44ba-9ab0-f7ea15aa4277 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.802206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28758-76a0-44ba-9ab0-f7ea15aa4277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.802468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4453b-4fd0-45e5-9d1e-27bf6d7a4da2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.802468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4453b-4fd0-45e5-9d1e-27bf6d7a4da2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.802468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4453b-4fd0-45e5-9d1e-27bf6d7a4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.829697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-52c28758-76a0-44ba-9ab0-f7ea15aa4277 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:58.830935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52c28758-76a0-44ba-9ab0-f7ea15aa4277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:58.835691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b1b4453b-4fd0-45e5-9d1e-27bf6d7a4da2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:58.837241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b1b4453b-4fd0-45e5-9d1e-27bf6d7a4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:58.846867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 765/1540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:58.853183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 776/1541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:21:58.862179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.864020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.864550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.865256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.865862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.866348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.904678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:58.906443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:58.908490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:58.915557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:58.927795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 766/1542] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:58.928176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 777/1543] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:58.932566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:58.933363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:58.948870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4194-8069-45f2-8a61-ec9d19f98226 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:58.953531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07080-e415-4f7d-a219-7a382061d161 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:58.961227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:58.962062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.962351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.962625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.963287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:58.963589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:58.964609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:58.964609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:21:58.964609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:21:58.965488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:58.965634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:58.966107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:58.966385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:58.966653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:58.967307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:58.967605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:58.969224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:58.987310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 778/1544] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:21:58.993064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 767/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:58.996263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.001254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.016572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba565-97d4-48ac-8831-7c1d699c2bd1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.019937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381194-dea8-445a-a107-5dfacccaff92 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.031338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.031546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.032012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.032338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.032464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.032635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.032774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.033256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.034275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:59.034275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:21:59.034275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:21:59.036593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073584e-1a24-40b3-9f40-7e9c982d35f2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.037234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.038069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.040120 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e331396-58e4-4153-9b6a-c2f9e03be8ae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.089704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 768/1546] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:21:59.089912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b3f-938f-4e3c-a1bc-519e33a75e8f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.090921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b3f-938f-4e3c-a1bc-519e33a75e8f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.091097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7b3f-938f-4e3c-a1bc-519e33a75e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.111786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 779/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:58 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.114115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159405-ccbb-441b-aa0b-5c380f7eddd6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.114681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159405-ccbb-441b-aa0b-5c380f7eddd6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.115131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159405-ccbb-441b-aa0b-5c380f7eddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.120401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8c2f7b3f-938f-4e3c-a1bc-519e33a75e8f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.121650 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c2f7b3f-938f-4e3c-a1bc-519e33a75e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.136249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7a159405-ccbb-441b-aa0b-5c380f7eddd6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.137505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a159405-ccbb-441b-aa0b-5c380f7eddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.182988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 769/1548] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.184098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.184387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.184679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.204710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 780/1549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.205102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.206121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd07fd-5d4b-4684-a282-89e1e3a30c52 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.207043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd07fd-5d4b-4684-a282-89e1e3a30c52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.207321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd07fd-5d4b-4684-a282-89e1e3a30c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.207442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.219104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 770/1550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.222534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.229479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f9bd07fd-5d4b-4684-a282-89e1e3a30c52 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.230775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f9bd07fd-5d4b-4684-a282-89e1e3a30c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.232211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ff55b-f230-4f55-b592-1938e9a1beec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.236822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.237421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.238375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.238755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.239376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.239491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 781/1551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.240691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c7f-d369-45c5-a7cb-f051079df979 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.240977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c7f-d369-45c5-a7cb-f051079df979 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.241247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c7f-d369-45c5-a7cb-f051079df979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.241339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.267459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 771/1552] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.267687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c4ae8c7f-d369-45c5-a7cb-f051079df979 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.267799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.267915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c4ae8c7f-d369-45c5-a7cb-f051079df979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.275130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 782/1553] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.275293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206da096-a661-470a-8a9e-4976815ea304 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.276385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d1c-e33c-4bad-9f62-49e1ab50aaee None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.276689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d1c-e33c-4bad-9f62-49e1ab50aaee None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.276965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d1c-e33c-4bad-9f62-49e1ab50aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.285633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.286456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.286741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.287018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.287680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.289658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442ba80-65d5-4bc9-85d7-71383dbf7353 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.297466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-59d30d1c-e33c-4bad-9f62-49e1ab50aaee None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.298649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-59d30d1c-e33c-4bad-9f62-49e1ab50aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.308052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 783/1554] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.309265 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546307-0723-470d-b9f7-5748d9002647 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.309544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546307-0723-470d-b9f7-5748d9002647 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.309811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546307-0723-470d-b9f7-5748d9002647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.312121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 772/1555] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.313543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078e5ed-f584-484c-80f5-05e3ec183bfc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.313907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078e5ed-f584-484c-80f5-05e3ec183bfc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.314287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078e5ed-f584-484c-80f5-05e3ec183bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.333156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1546307-0723-470d-b9f7-5748d9002647 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.334369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1546307-0723-470d-b9f7-5748d9002647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.334502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3078e5ed-f584-484c-80f5-05e3ec183bfc None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.335522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3078e5ed-f584-484c-80f5-05e3ec183bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.342280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 784/1556] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.343325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 773/1557] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.344476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.344794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.345069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.346998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c479c6-b890-4a64-86dd-7877cda2b868 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.347292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c479c6-b890-4a64-86dd-7877cda2b868 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.347753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c479c6-b890-4a64-86dd-7877cda2b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.364994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.366182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.367271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04c479c6-b890-4a64-86dd-7877cda2b868 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.368409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04c479c6-b890-4a64-86dd-7877cda2b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.373961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 774/1558] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.374716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.379883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 785/1559] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.379883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eaa6-a0a0-4804-bc19-27d691f5d04d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.379883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eaa6-a0a0-4804-bc19-27d691f5d04d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.379883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eaa6-a0a0-4804-bc19-27d691f5d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.385465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20da3b-4247-44f7-a69d-797e54d5e1d4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.390141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.390763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.391046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.391314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.391949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.393583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.397962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a015eaa6-a0a0-4804-bc19-27d691f5d04d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.399145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a015eaa6-a0a0-4804-bc19-27d691f5d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.403636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 775/1560] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:59.404410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.407243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 786/1561] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.408401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.408707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.408983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.420546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd332-6557-4f40-b291-f35c0c803c80 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.427110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.427828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.428223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.428589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.428769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:59.429443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.430004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:59.431214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.437976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 787/1562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:59.438759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.442263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 776/1563] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:59.443062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.450377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036e76-2245-4209-a616-e76273ce6ab4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.452203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7bf9a-0adf-44e9-a5db-199765352b63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.454922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.455512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.455790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.456067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.456773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.456915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.457099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.457494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.457769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.458038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.458667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.458763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.458963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.460523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.471995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 788/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.472586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 777/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.473462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.473598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.483761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491b53-b55d-4ee4-8e40-8cebdadac772 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.485073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcca2d-a549-4f45-bdf2-ed81a55dc76d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.489148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.489742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.490011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.490138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.490275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.490622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.490895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.491013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.491163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.491289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.491824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.492122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.492785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.493928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.501854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:59.506347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 778/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.507200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.508393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 789/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.509602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.522903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ec7f-afaa-4055-a2ff-9bd1214d13ac admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.523089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279a4b-1618-4aa6-84d4-0f87b761c40d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.527533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.527689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.528186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.528302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.528463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.528608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.528836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.528948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.529476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.529597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.529773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.531079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.531370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.541451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 779/1568] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:59.542240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.548548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 790/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.548548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.552549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e328-2692-4d40-b8c8-b1b40c0e903c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.557219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.557805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.558078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.558344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.558812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb40b9-2228-4481-9625-72dcb9500a71 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.558966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.560545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.563282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.563859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.564134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.564400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.565058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:59.565354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.567832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.571048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 780/1570] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:59.571805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.586960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 791/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:59.586960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.587230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d920-4e97-4761-8584-d52009e70981 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.587230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.587230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.587502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.587585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:59.587670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.588165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.590473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.591221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bed81-94dc-4952-beb0-55d3c8f351c0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.596817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.597789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.598110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.598379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.598988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.600907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.618647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 781/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.619350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.632276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 792/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.633180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.686346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723333-59b1-420d-a6c6-d0ceb9926b43 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.697470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0962aeb-3485-4025-90a2-5855a4c1dd1b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.702087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.702690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.702968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.703232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.703847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.705774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.738620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 793/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.738620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.745491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.746132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.746408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.746675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.747298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.749334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.778896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 782/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.779952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.804378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac7598-57e1-45ef-b9a9-a6e5b2a39811 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.828963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:59.845949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f8d3-3727-4b38-8f94-42febefdcbe5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.851254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.852050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.852321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.852588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.853236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.855142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.861111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.861765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.862038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.862317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] PATH_INFO: `/v3/projects/170491fbfb1f4deab03bc1102d215d76/users/e536559b9c084a6bafb9d2ce8b493c65/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.879417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=170491fbfb1f4deab03bc1102d215d76, user_id=e536559b9c084a6bafb9d2ce8b493c65, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.882101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.884367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 783/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:59.885583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.891470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:59.898175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 794/1577] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:21:59 2022] PUT /identity/v3/projects/170491fbfb1f4deab03bc1102d215d76/users/e536559b9c084a6bafb9d2ce8b493c65/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:21:59.899240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:59.949975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa06e5-8d79-41cb-a2e3-9dff90d8c2cc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.962534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364b93-dfb8-4746-86ea-1cd7f4ef74cc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:59.967221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:59.967826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:59.968114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:59.968390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:59.969040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:59.970952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:59.999107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 795/1578] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.000123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.008271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.009003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.009281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.009550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] PATH_INFO: `/v3/projects/fefb9a3f45414993a77653ca20b38ab4/users/c7d5c3d673104612abaa4661edd37401/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.024796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefb9a3f45414993a77653ca20b38ab4, user_id=c7d5c3d673104612abaa4661edd37401, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.025962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:22:00.025962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:22:00.025962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:22:00.028590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.042353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 784/1579] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:21:59 2022] PUT /identity/v3/projects/fefb9a3f45414993a77653ca20b38ab4/users/c7d5c3d673104612abaa4661edd37401/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.043137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.063595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0587-b43b-4b22-862f-76236050ca5a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.109218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236f53d-02bd-4554-a483-235e5291574e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.114551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.115159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.115436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.115823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.116449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.118437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.121229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.121834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.122108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.122376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.122980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.124009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:22:00.124009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:22:00.124009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:22:00.125227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.128813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:00.142130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 785/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.142910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.150737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 796/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:21:59 2022] POST /identity/v3/users => generated 305 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.150737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.152430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b71fb-cbc0-46cc-bc2b-2846eb7e71a4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.157174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.157804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.158084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.158382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.158994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.160005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9de2f-27b6-43ce-a33f-f04165ea5ed0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.161066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.164566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.165254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.165534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.165804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.166414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.168307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b92f9-a4e6-4be9-9a3e-1acff2a03e0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.182849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 786/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/users => generated 282 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.183741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.192452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 797/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.193764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28104ab-a868-488c-a7d6-e7e4ee0df420 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.194038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28104ab-a868-488c-a7d6-e7e4ee0df420 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.194309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28104ab-a868-488c-a7d6-e7e4ee0df420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.195506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d367-31a9-44e6-b5f5-dac6b105de3e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.199962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.200598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.200901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.201159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:00.201273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.201770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.203699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.215240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f28104ab-a868-488c-a7d6-e7e4ee0df420 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:00.217105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f28104ab-a868-488c-a7d6-e7e4ee0df420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:00.225207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 787/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.229074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 798/1585] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:00.229214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.229327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.229327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.229327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.241148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1c8b-c621-4904-a89d-6bc1f3d06598 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.246178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.246781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.247179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.247453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.247947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:00.248077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.249199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:00.250163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.257854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 799/1586] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:00.261861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.272929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f74ab-efbd-4be7-93fe-065ad1769f2d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.276823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 788/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:00.277659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.281222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.281864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.282142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.282415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.283060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.284850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.287422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d445e-295f-4961-8689-e96cd8ab40be admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.292236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.292883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.293171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.293458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.294853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.294965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 800/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.295760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.299383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.305956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e0d37-0651-48d0-83f5-6e92607675ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.313589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 789/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.313752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.313868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.313962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.313962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.313962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.313962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.314427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.321270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef322-e4cc-4a85-809a-470c3e631f53 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.325535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 801/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.325802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.326252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.326384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.326666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.326992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.327561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.329179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.335592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150565d-7e5d-4e5e-ab03-0b852813b1d6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.339641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 790/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.340514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.343223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.343814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.344089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.344356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.345007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.346604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.358571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 802/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.362297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.397507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191b21f-80a1-4900-a78e-381c1e5a59db admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.401142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.401748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.402028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.402295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.411987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.413655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.421623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072635-01c7-4ffd-919b-0300ea79bbe5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.423448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 791/1593] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:00.425860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.426232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.426848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.427123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.427391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.437344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.437693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013309f9-81b8-44e1-9169-a28a50efbbb5 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.438775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.443502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.444110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.444544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.444863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.445512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.447115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.450856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 803/1594] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:00.451538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.461858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 792/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.461858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.464778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8bee6-93f1-43be-816c-8510db2ed752 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.470252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.470796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87a6-7b67-4aab-8eff-51ec28bd1b1c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.470905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.471124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.471393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.472766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.474382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.476209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.477109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.477392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.477666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.478402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.479895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.486267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 804/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.486541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.498845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 793/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.498845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.499099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191357ac-46a9-47b3-9078-3605b17971d0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.503639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.504269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.504549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.504849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.505508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.507098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.509209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea31c-9a07-47e8-98a7-47d591d5aae1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.514815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.515582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.515902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.516181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.516865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.518087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 805/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.518622 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.522319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.531294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 794/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.532703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.534232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813290b3-3bd9-404a-8e5c-163a27f9f8e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.541508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.542689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.543089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.543522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.544463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.544909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33849ec-7c93-4046-83dc-cf62432f1bea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.546618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.550096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.551578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.552077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.552570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.553270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.554901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.560967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 806/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.564213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.572993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 795/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:00.572993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.580018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044735-c348-4d5c-8a5d-5e56dfb1bddd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.584887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070206-0833-4dde-8a34-348fcb120e0c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.585773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.586407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.586687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.586959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] PATH_INFO: `/v3/projects/d41dada83c5f4feb8a07951d81534d71/users/eb814943acea43e8bffb22c8229ae0f5/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.591937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.593423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.593539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.593799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] PATH_INFO: `/v3/projects/e97d94f67b904511baf9d1b1ef2f98dd/users/8570d7867ee640c4bb7432785e7f9693/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.605728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41dada83c5f4feb8a07951d81534d71, user_id=eb814943acea43e8bffb22c8229ae0f5, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.608455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.613479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97d94f67b904511baf9d1b1ef2f98dd, user_id=8570d7867ee640c4bb7432785e7f9693, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.616967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.625746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 807/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/d41dada83c5f4feb8a07951d81534d71/users/eb814943acea43e8bffb22c8229ae0f5/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.634233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.634837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 796/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/e97d94f67b904511baf9d1b1ef2f98dd/users/8570d7867ee640c4bb7432785e7f9693/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.636063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.663110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:00.721862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9587-ba12-412a-8673-be72b8f389f1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.722774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c347d33-a534-448c-81f1-ddd837195cfa admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.727748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.728223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.728595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.728975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.729103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.729334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.729601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] PATH_INFO: `/v3/projects/6f6788cbeea64d248fe5627614d1b88c/users/470cc664cf7841b18a03d70e962bd51d/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.729868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] PATH_INFO: `/v3/projects/db302f8503ec4f56b4dd26e61ccd3d90/users/bcf8360980c64096ab7187a38895612e/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.734375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:00.750991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6788cbeea64d248fe5627614d1b88c, user_id=470cc664cf7841b18a03d70e962bd51d, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.755017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.755940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db302f8503ec4f56b4dd26e61ccd3d90, user_id=bcf8360980c64096ab7187a38895612e, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.759494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.776293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 808/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/6f6788cbeea64d248fe5627614d1b88c/users/470cc664cf7841b18a03d70e962bd51d/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.778490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.798067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 797/1605] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/db302f8503ec4f56b4dd26e61ccd3d90/users/bcf8360980c64096ab7187a38895612e/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.799090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:00.868924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cd3ca-c11a-44c0-929e-4555215ef411 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.891891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ad1b-eaff-4ab0-8096-f531c63bf436 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:00.898055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:00.899008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.899532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.900007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] PATH_INFO: `/v3/projects/afd6766c1cf2407f90e9ac61eb022ca0/users/53a8aad1e7d34b7c89a3f694cb40261b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.929640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd6766c1cf2407f90e9ac61eb022ca0, user_id=53a8aad1e7d34b7c89a3f694cb40261b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:00.933587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebb2f3-b41f-4aac-9471-2821cddf733e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:00.952982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 798/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/afd6766c1cf2407f90e9ac61eb022ca0/users/53a8aad1e7d34b7c89a3f694cb40261b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:00.954783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c7117-86b8-4c43-acff-953eb728f0fe None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:00.955254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c7117-86b8-4c43-acff-953eb728f0fe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:00.955786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c7117-86b8-4c43-acff-953eb728f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:00.990944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b81c7117-86b8-4c43-acff-953eb728f0fe None None] MFA Rules not processed for user `eb814943acea43e8bffb22c8229ae0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:00.992527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b81c7117-86b8-4c43-acff-953eb728f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.072222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.073103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.073390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.073670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] PATH_INFO: `/v3/projects/e7a69fa48c1947e290f37dcc906f1995/users/4b003f07f7f64761a1935fd2f11187b6/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.079695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 799/1607] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.082229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5b05-5159-45f3-b240-21c2f18d3f9d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.082621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5b05-5159-45f3-b240-21c2f18d3f9d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.082932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5b05-5159-45f3-b240-21c2f18d3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.115661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a69fa48c1947e290f37dcc906f1995, user_id=4b003f07f7f64761a1935fd2f11187b6, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.118595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a7b98-9d3b-48a5-a81a-d23ff2a22654 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.122343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:01.143291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6c2c5b05-5159-45f3-b240-21c2f18d3f9d None None] MFA Rules not processed for user `8570d7867ee640c4bb7432785e7f9693`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.144582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 809/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:00 2022] PUT /identity/v3/projects/e7a69fa48c1947e290f37dcc906f1995/users/4b003f07f7f64761a1935fd2f11187b6/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:01.144884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c2c5b05-5159-45f3-b240-21c2f18d3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.146978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfc-386d-4ce5-85e7-6f1d83dc18a6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.147462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfc-386d-4ce5-85e7-6f1d83dc18a6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.147921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adbfc-386d-4ce5-85e7-6f1d83dc18a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.207601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d49adbfc-386d-4ce5-85e7-6f1d83dc18a6 None None] MFA Rules not processed for user `470cc664cf7841b18a03d70e962bd51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.211966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d49adbfc-386d-4ce5-85e7-6f1d83dc18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.268817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 800/1609] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.270348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2612c-3144-4965-9cbf-1308acc9c30e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.270638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2612c-3144-4965-9cbf-1308acc9c30e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.270910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2612c-3144-4965-9cbf-1308acc9c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.295804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-eaa2612c-3144-4965-9cbf-1308acc9c30e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.297054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eaa2612c-3144-4965-9cbf-1308acc9c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.321872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 810/1610] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.323674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.324376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.361061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.361061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:01.361061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.361061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.407828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 801/1611] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.410767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3039b3-c633-45e1-ae48-94a8287f3f9a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.411418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3039b3-c633-45e1-ae48-94a8287f3f9a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.416827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3039b3-c633-45e1-ae48-94a8287f3f9a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.418227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 802/1612] 10.222.0.26 () {54 vars in 962 bytes} [Mon Aug 8 02:22:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:01.420340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.420834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.421121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.443206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 811/1613] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.446507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.454743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9721b0-b7f3-4eb0-a5df-a5111a1b0a31 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.460243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.460891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.461165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.461432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.462058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.463966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.475979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] MFA Rules not processed for user `4b003f07f7f64761a1935fd2f11187b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.477739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.499276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 812/1614] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:01.504240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.613133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 803/1615] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.624757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.637272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87aba-5a44-4595-a908-222dfb1a77ff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.653861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.654488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.654769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.655039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.655937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.658125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ddb7e-9f0f-40e0-9632-a00b09c5fcee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.674100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:01.712862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 813/1616] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:01.714480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.714768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.715040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.723462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6ee5-bfcc-45d2-8558-e2e8d51142b2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.788274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:01.791005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:01.807705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.808814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.809293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.809561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.892878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:01.901002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.903311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.917403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 804/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:01.918433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.927837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a7e9f-75fd-4e81-9a0f-d4411c86216b service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.932194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.933130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.933286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 814/1618] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:01.933380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.933786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.934595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.949348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.951072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40949828-2e4a-4dc3-9c7d-0eb4e5cf7013 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.951745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94560-86f7-4a17-880b-652ab27fc4ad None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.957816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:01.958940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.960682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.961103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.962015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:01.965179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:01.966861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 805/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:01.968510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833803bd-8691-4382-82cb-5b3cfc607274 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:01.968954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833803bd-8691-4382-82cb-5b3cfc607274 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:01.969421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833803bd-8691-4382-82cb-5b3cfc607274 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:01.970978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 806/1620] 10.222.0.26 () {54 vars in 962 bytes} [Mon Aug 8 02:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:01.973350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833803bd-8691-4382-82cb-5b3cfc607274 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:01.996361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833803bd-8691-4382-82cb-5b3cfc607274 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:01.999505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 815/1621] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/users => generated 311 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:02.000681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.006831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.008940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.010423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.012038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.015291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.018598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87105f42-d4eb-4d99-8457-dda65c1ed602 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.019687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b6f0e-8ff0-426d-b14e-0d4f093c9e9b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.026530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.027718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.027718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.027899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.064220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 807/1622] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:01 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:02.066813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.067843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.068488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.099869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:02.101583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:02.105774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.108215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.122081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 816/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:02.123746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 808/1624] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Aug 8 02:22:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:02.125402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.140631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.141878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407084a-9ec8-440a-9b01-b0f33f1256c6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.157248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.159241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.162762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.164384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.165186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.170992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.175557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60ca8-5a0b-449e-9d41-c433d47e1428 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.188772 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.189395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.189670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.191993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.193966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.199259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 809/1625] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:02.200076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.200182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.219514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 817/1626] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:02.220509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.220666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b3c1-191a-4009-89c2-87ad5ff7a210 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.232234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b088c-2d6f-49f3-97c4-337407bc3408 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.236025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.236672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.236968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.237232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.238182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.240388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.240758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.241165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] PATH_INFO: `/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42/users/9ff2ba976cd947e0a146055f9c8baa9f/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.264899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7876f4d2f2c84851a50d2d5c1951eb42, user_id=9ff2ba976cd947e0a146055f9c8baa9f, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.269384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.299320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 818/1627] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:02 2022] PUT /identity/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42/users/9ff2ba976cd947e0a146055f9c8baa9f/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:02.301108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.326223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:02.349163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.351473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.366621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 810/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:02.368103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.380979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb727a65-bb5a-4441-a2ad-cd17136f11aa service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.447455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0efb64-3b74-47fb-88c4-d756ef812817 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.455687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.456877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.457154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.457420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.458554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.459597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.460364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.460889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.462460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.462819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] PATH_INFO: `/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a/users/0656f118cf2e41ad8367a3523874559c/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.478003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 811/1629] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:02.480245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.500632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630fa9b14b8c4e4e81e69502e7189c8a, user_id=0656f118cf2e41ad8367a3523874559c, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.503541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d117e8-4186-4a22-90ed-f853f0e8ef56 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.508708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928ea1-779d-4d74-8a43-461e4ad93844 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.514322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.514976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.515253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.515594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] PATH_INFO: `/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42/users/9ff2ba976cd947e0a146055f9c8baa9f/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.522291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7876f4d2f2c84851a50d2d5c1951eb42, user_id=9ff2ba976cd947e0a146055f9c8baa9f, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.529325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.537343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 819/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:02 2022] PUT /identity/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a/users/0656f118cf2e41ad8367a3523874559c/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:02.545207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875362e0-540b-4861-875e-c4400b7f0bc5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.545577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875362e0-540b-4861-875e-c4400b7f0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.546507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875362e0-540b-4861-875e-c4400b7f0bc5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.557696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 812/1631] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:02 2022] PUT /identity/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42/users/9ff2ba976cd947e0a146055f9c8baa9f/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:02.557696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.557916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 820/1632] 10.222.0.26 () {54 vars in 912 bytes} [Mon Aug 8 02:22:02 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:02.557916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.557916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.557916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.605805 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:02.607433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:02.633536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:02.648193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcd1d-68fa-4976-81c2-15f79e96d381 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.653251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.653885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.654147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.654441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.655386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.657916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf8ad4-b2ad-41a9-a5de-a360e4970753 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.672238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 813/1633] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:02.673763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.674052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.674381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.709822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] MFA Rules not processed for user `9ff2ba976cd947e0a146055f9c8baa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:02.711281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:02.778069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:02.791113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 821/1634] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:22:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:02.793390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.804077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 814/1635] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:02 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:02.807956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.835296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608c71-dd5a-44ce-9b1b-bd8397b29e79 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.846481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.849502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.852132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.852727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] PATH_INFO: `/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a/users/0656f118cf2e41ad8367a3523874559c/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:02.857638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630fa9b14b8c4e4e81e69502e7189c8a, user_id=0656f118cf2e41ad8367a3523874559c, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:02.866041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:02.882482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff10596-5104-480b-ae9e-ad75f7001aae None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:02.898424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 822/1636] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:02 2022] PUT /identity/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a/users/0656f118cf2e41ad8367a3523874559c/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:02.900780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:02.955189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:02.957144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:02.957621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:02.958339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.043899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166265b-0dfc-4c28-b409-c46c7cb27ef0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:03.053621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:03.055122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:03.056121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:03.056484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.111780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:03.114802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f3d87-2f0c-45d4-98d9-e38583c8844a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:03.145544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 815/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:03.148882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:03.149872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:03.150969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.165705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:03.167095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c69d8-f8b3-4848-b4e1-1914c1c3a234 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:03.191928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 823/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:03.194405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a4ce-1b4c-4ce4-a4d8-acb07dc87911 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:03.202987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a4ce-1b4c-4ce4-a4d8-acb07dc87911 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:03.203455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a4ce-1b4c-4ce4-a4d8-acb07dc87911 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.206039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 824/1639] 10.222.0.26 () {54 vars in 912 bytes} [Mon Aug 8 02:22:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:03.215312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:03.215744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:03.216111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.223665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] MFA Rules not processed for user `0656f118cf2e41ad8367a3523874559c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:03.225605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:03.258494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:03.263400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:03.290756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 825/1640] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:03.312098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:03.445221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 816/1641] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:03.595536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:03.618158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78654d6-17d7-4c6a-a341-dbda96cae9d5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:03.631361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:03.636614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:03.636614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:03.647139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:03.666405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:03.671003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:03.706979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 826/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:04.151306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:04.167306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860172ee-a01e-4464-87e8-48b68b97fc5d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:04.180209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:04.181131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:04.181692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:04.182105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:04.207824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:04.213222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:04.265918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 817/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:04.326463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:04.337212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42d73-cf9a-474e-80b4-3629ed49514d service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:04.342357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:04.342971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:04.343242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:04.343574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:04.407993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:04.535747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:04.537442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:04.578810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 827/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:05.131540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:05.142349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438333-3849-436f-9d35-cff1ecf0a08e service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:05.156860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:05.161895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:05.162799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:05.164442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:05.344302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:05.346700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e2fce-3af4-48a6-aa2b-5d93d13fd256 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:05.363131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 818/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:08.808133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:08.996507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946eafa-c216-466a-b22a-8437014b2ed0 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:09.013337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:09.015777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:09.017584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:09.017584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] PATH_INFO: `/v3/users/4b003f07f7f64761a1935fd2f11187b6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:09.023623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b003f07f7f64761a1935fd2f11187b6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:09.037336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:09.223003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b003f07f7f64761a1935fd2f11187b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:09.244611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b003f07f7f64761a1935fd2f11187b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:09.245441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b003f07f7f64761a1935fd2f11187b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:09.247683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b003f07f7f64761a1935fd2f11187b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:09.276720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b003f07f7f64761a1935fd2f11187b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:09.332845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 828/1646] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:08 2022] DELETE /identity/v3/users/4b003f07f7f64761a1935fd2f11187b6 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:09.337127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:09.338081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:09.338511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:09.388914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:09.390742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:09.597030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 819/1647] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:09.644252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:09.646914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:09.843622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:09.894269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c319-a5e2-4537-a8a9-72b77104e3e1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:09.911843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:09.912485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:09.914176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:09.914460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:09.946592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:09.948124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a191e1-698b-4fc9-abe3-f730df2c14bd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:09.982350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 829/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:10.640150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:10.642984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:10.667914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461719b-3658-490b-b1c2-834c825acdfb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:10.685877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:10.686925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:10.688754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:10.689236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] PATH_INFO: `/v3/users/eb814943acea43e8bffb22c8229ae0f5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:10.694895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb814943acea43e8bffb22c8229ae0f5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:10.696217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:22:10.696217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Aug 08 02:22:10.696217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: Aug 08 02:22:10.702026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:10.938685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb814943acea43e8bffb22c8229ae0f5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:10.943918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:10.959739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb814943acea43e8bffb22c8229ae0f5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:11.004362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb814943acea43e8bffb22c8229ae0f5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:11.016235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb814943acea43e8bffb22c8229ae0f5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:11.017380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb814943acea43e8bffb22c8229ae0f5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:11.105747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 820/1649] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:10 2022] DELETE /identity/v3/users/eb814943acea43e8bffb22c8229ae0f5 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:11.110903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:11.111944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:11.113019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:11.150800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:11.153777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:11.428272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 830/1650] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:11.465740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:11.469522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:11.668285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c02b-35ed-4a31-adbb-3ac93106f4f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:11.684368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:11.685124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:11.685327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:11.685602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:11.724967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:11.726454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579ac7-4e93-446d-bc69-518166f9d0c9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:11.761567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 821/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:11.828097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:11.830009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:11.870799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b3f6-c3ef-4740-a0af-cab38835d621 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:11.886908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:11.888000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:11.890529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:11.891081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] PATH_INFO: `/v3/projects/e7a69fa48c1947e290f37dcc906f1995` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:11.895305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a69fa48c1947e290f37dcc906f1995)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:11.901524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:22:11.901524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Aug 08 02:22:11.901524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: Aug 08 02:22:11.904680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:12.065871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a69fa48c1947e290f37dcc906f1995', 'request_id': 'req-3e1aa001-c138-47bb-a10f-290c091f2c48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:12.101541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a69fa48c1947e290f37dcc906f1995', 'request_id': 'req-3e1aa001-c138-47bb-a10f-290c091f2c48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:12.116601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a69fa48c1947e290f37dcc906f1995', 'request_id': 'req-3e1aa001-c138-47bb-a10f-290c091f2c48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:12.183632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] The token cache is being invalidate because project e7a69fa48c1947e290f37dcc906f1995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:12.184313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:12.185214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e1aa001-c138-47bb-a10f-290c091f2c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:12.187824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 831/1652] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:11 2022] DELETE /identity/v3/projects/e7a69fa48c1947e290f37dcc906f1995 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:12.192577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.193077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.193524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.242806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:12.246602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:12.445310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 822/1653] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:12.453262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.453627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.454118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.578894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:12.581310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:12.609559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 832/1654] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:12.614842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:12.626065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc7e92-496f-4265-aee7-da35b6efdf62 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:12.631341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:12.632067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.632416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.634504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.635312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:12.638595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:12.640386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:12.656628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 823/1655] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:12.663339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:12.690217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2aa8c-d3a8-45ba-87b8-db5e63f41abc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:12.700141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:12.701129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.702036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.702505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.703606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:12.709954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:12.773584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 833/1656] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:12 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:12.778780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:12.793803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c6c7-7487-42dc-b26d-914b4965e278 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:12.874337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:12.875100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.875452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.875792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.876512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:12.879597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:12.890664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:12.927412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 824/1657] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:12 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:12.933644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:12.962519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6341e-d695-41be-896d-7d624670c535 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:12.972448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:12.973613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:12.974085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:12.974483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:12.975709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:12.978470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:12.994074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 834/1658] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:12.997049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:13.009675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0a4a-2d14-429c-b439-0da44614ddc3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:13.020445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:13.023043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.023399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.023764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.024902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:13.029813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eccb89-b565-4a39-b80d-72486808541a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:13.059055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 825/1659] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:13.063461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:13.077562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779f787-a189-40b3-8de4-0405ea65a6ec admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:13.099908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:13.100760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.101162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.101507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] PATH_INFO: `/v3/projects/a729916906a34eb88afc57924d866a46/users/65e72cc28cf44889b13f57326f61e13a/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.128855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a729916906a34eb88afc57924d866a46, user_id=65e72cc28cf44889b13f57326f61e13a, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:13.135518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:13.156355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 835/1660] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:13 2022] PUT /identity/v3/projects/a729916906a34eb88afc57924d866a46/users/65e72cc28cf44889b13f57326f61e13a/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:13.167225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.167924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.168199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.237744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] MFA Rules not processed for user `65e72cc28cf44889b13f57326f61e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:13.239080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:13.337290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:13.339764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:13.355960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:13.474877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 826/1661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:13.481564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:13.590586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111c44-2029-406a-b0a2-0086e2a185a1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:13.607393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:13.608663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.609161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.609584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] PATH_INFO: `/v3/users/8570d7867ee640c4bb7432785e7f9693` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.611129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8570d7867ee640c4bb7432785e7f9693)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:13.616162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:13.694216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64938ec6-91f9-40fa-89d6-9bffc4620331 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:13.703775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:13.704669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.706917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.707359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.708254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:13.710863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:13.753113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8570d7867ee640c4bb7432785e7f9693'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:13.775462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8570d7867ee640c4bb7432785e7f9693'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:13.776241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8570d7867ee640c4bb7432785e7f9693'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:13.777162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8570d7867ee640c4bb7432785e7f9693'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:13.801853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 827/1662] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:13 2022] POST /identity/v3/projects => generated 357 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:13.805358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4aa5dd2e-4187-4d22-8abb-0ed6e428bcf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8570d7867ee640c4bb7432785e7f9693'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:13.815579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:13.819457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:13.845676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 836/1663] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:13 2022] DELETE /identity/v3/users/8570d7867ee640c4bb7432785e7f9693 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:13.850356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203092e-05f7-47ed-8449-a2e561c31a53 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.850658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203092e-05f7-47ed-8449-a2e561c31a53 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.850930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203092e-05f7-47ed-8449-a2e561c31a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.882677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0203092e-05f7-47ed-8449-a2e561c31a53 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:13.885832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0203092e-05f7-47ed-8449-a2e561c31a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:13.974096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.001317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a46e-d8c8-48fa-b31c-0b28dd4dd392 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.036159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 837/1664] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:14.038074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.038361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.038633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.093725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] MFA Rules not processed for user `c7d5c3d673104612abaa4661edd37401`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:14.098408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.114057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.139921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.141167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.141904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.142485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.144539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.147289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.204297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 828/1665] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:13 2022] POST /identity/v3/users => generated 285 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:14.209926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.243371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e22f-4bc7-4942-b4c0-4a184a23afae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.249983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 838/1666] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:14.251782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.254984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.257157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.257899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.258179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.258467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.259231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.263237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4f54-06e5-4137-b829-8f363e09cfac admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.307692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 829/1667] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:14.311121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.311417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.312903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.363594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] MFA Rules not processed for user `e536559b9c084a6bafb9d2ce8b493c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:14.365476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.426180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753a3c-3192-4134-880f-a43b43e2f289 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.444359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.445016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.451916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.452317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.465207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.468940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f3a6b-e2a7-4ab1-b97c-b44c02318d24 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.503559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 839/1668] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:14.505122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.505410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.505715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.521931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 830/1669] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:14.523110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.566696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c477ab-c4b5-4b76-a73e-b4262191b889 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.568680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] MFA Rules not processed for user `c7d5c3d673104612abaa4661edd37401`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:14.576227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.578562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.579863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.579863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.580057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] PATH_INFO: `/v3/projects/c8876a82609a49cd81e724306658a9d7/users/efec3a5032534148842d3ae80a784779/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.608208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 840/1670] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:14.609241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.613488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.624560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8876a82609a49cd81e724306658a9d7, user_id=efec3a5032534148842d3ae80a784779, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.628378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.652623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 831/1671] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:14 2022] PUT /identity/v3/projects/c8876a82609a49cd81e724306658a9d7/users/efec3a5032534148842d3ae80a784779/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:14.653885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.657992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.755661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.811945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e83fd5-8ccc-4bb2-a03c-e06b15b0a472 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.823092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.824064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.824758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.825281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.833666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5050-bc10-4af1-b1fb-d3d8fd951734 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.852903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.853549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.853846 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.854485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.950293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.960672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.962398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.966653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.969271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.979827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 832/1672] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:14.985027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 841/1673] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:14.997847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:15.126330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac23f-14f6-4b97-abb6-4d370c51b38e service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:15.139899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:15.140811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:15.141157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:15.141498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:15.142224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:15.145920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c469d0-038f-464e-a04e-f844146c786d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:15.173934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:15.175858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 833/1674] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:15.195907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd151c1-830e-4e29-b285-c0b1402c2356 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:15.216472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:15.217587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:15.218007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:15.218449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] PATH_INFO: `/v3/projects/c8876a82609a49cd81e724306658a9d7/users/efec3a5032534148842d3ae80a784779/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:15.237812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8876a82609a49cd81e724306658a9d7, user_id=efec3a5032534148842d3ae80a784779, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:15.246039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:15.296881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 842/1675] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:15 2022] PUT /identity/v3/projects/c8876a82609a49cd81e724306658a9d7/users/efec3a5032534148842d3ae80a784779/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:15.311107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:15.311107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:15.311107 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:15.364349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] MFA Rules not processed for user `efec3a5032534148842d3ae80a784779`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:15.365824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:15.390058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:15.392317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:15.496310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a55a0-ef6e-401e-b87f-5ba57d58fce4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:15.507661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 834/1676] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:15.520720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:15.521387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:15.521669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:15.521958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] PATH_INFO: `/v3/projects/d41dada83c5f4feb8a07951d81534d71` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:15.525429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41dada83c5f4feb8a07951d81534d71)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:15.527539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:15.528833 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:15.528993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:15.542392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:15.664946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41dada83c5f4feb8a07951d81534d71', 'request_id': 'req-4b3715d2-1287-4902-a591-9c2cf466e3ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:15.698655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41dada83c5f4feb8a07951d81534d71', 'request_id': 'req-4b3715d2-1287-4902-a591-9c2cf466e3ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:15.717675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589dc12-f40d-44f7-aa49-f44bb3f76752 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:15.726409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41dada83c5f4feb8a07951d81534d71', 'request_id': 'req-4b3715d2-1287-4902-a591-9c2cf466e3ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:15.775467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] The token cache is being invalidate because project d41dada83c5f4feb8a07951d81534d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:15.775765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:15.783821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:15.790627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 843/1677] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:15 2022] DELETE /identity/v3/projects/d41dada83c5f4feb8a07951d81534d71 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:15.790627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:15.793393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:15.905273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:15.906055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:15.906435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:15.906808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:15.910710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.050594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3715d2-1287-4902-a591-9c2cf466e3ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:16.069751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:16.070783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.072425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.073621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] PATH_INFO: `/v3/users/470cc664cf7841b18a03d70e962bd51d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.076619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470cc664cf7841b18a03d70e962bd51d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:16.086328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:16.106470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:16.158130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:16.162189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:16.201440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 835/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:22:16.207389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:16.212294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.250192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470cc664cf7841b18a03d70e962bd51d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.279795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e4ba-2e20-45e3-98ad-c6ea3bd83dce service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:16.295719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470cc664cf7841b18a03d70e962bd51d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.297604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470cc664cf7841b18a03d70e962bd51d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.299416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470cc664cf7841b18a03d70e962bd51d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.306021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:16.309380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.311494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.313423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] PATH_INFO: `/v3/projects/e97d94f67b904511baf9d1b1ef2f98dd` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.318915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97d94f67b904511baf9d1b1ef2f98dd)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:16.324554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:16.337741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8795b50a-415a-46de-a5b9-d68a39828260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470cc664cf7841b18a03d70e962bd51d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.433288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 844/1679] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:15 2022] DELETE /identity/v3/users/470cc664cf7841b18a03d70e962bd51d => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:16.435716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bf5e-e7fa-44c6-ae6d-1b2023b48291 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.437786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bf5e-e7fa-44c6-ae6d-1b2023b48291 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.438186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89bf5e-e7fa-44c6-ae6d-1b2023b48291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.494733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bc89bf5e-e7fa-44c6-ae6d-1b2023b48291 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:16.496913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc89bf5e-e7fa-44c6-ae6d-1b2023b48291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.498870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97d94f67b904511baf9d1b1ef2f98dd', 'request_id': 'req-b1b82a59-488d-4ade-91bb-2fefc644dc8e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.512074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97d94f67b904511baf9d1b1ef2f98dd', 'request_id': 'req-b1b82a59-488d-4ade-91bb-2fefc644dc8e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.522962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:16.535074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97d94f67b904511baf9d1b1ef2f98dd', 'request_id': 'req-b1b82a59-488d-4ade-91bb-2fefc644dc8e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.560940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] The token cache is being invalidate because project e97d94f67b904511baf9d1b1ef2f98dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:16.562679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.565014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:16.570150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 836/1680] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:16 2022] DELETE /identity/v3/projects/e97d94f67b904511baf9d1b1ef2f98dd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:16.570150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:16.573590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.674835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 845/1681] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:16.680513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4182f9-00f8-484b-8d62-b90a16f84cdb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.680728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4182f9-00f8-484b-8d62-b90a16f84cdb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.681207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4182f9-00f8-484b-8d62-b90a16f84cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.744961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b4182f9-00f8-484b-8d62-b90a16f84cdb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:16.748042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b4182f9-00f8-484b-8d62-b90a16f84cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.765712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a59-488d-4ade-91bb-2fefc644dc8e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:16.771317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 846/1682] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:16.781378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.782133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.782933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:16.783343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.786040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.786040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.786040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.788538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 847/1683] 10.222.0.26 () {54 vars in 912 bytes} [Mon Aug 8 02:22:16 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:16.800225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:16.801260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.803372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:16.847739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45c07-9949-4406-84cd-ebad2f7e6ef1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:16.860510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:16.861344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.861728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.862140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] PATH_INFO: `/v3/users/9ff2ba976cd947e0a146055f9c8baa9f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.864119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff2ba976cd947e0a146055f9c8baa9f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:16.866242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:16.935757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:16.937566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a69ae8-75f0-4ec9-b810-4d8ff56623c4 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:16.976933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 837/1684] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:16.984803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:16.985837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:16.986720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:16.987336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff2ba976cd947e0a146055f9c8baa9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:17.004764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff2ba976cd947e0a146055f9c8baa9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:17.006757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff2ba976cd947e0a146055f9c8baa9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:17.008894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff2ba976cd947e0a146055f9c8baa9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:17.024874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e5b91665-a361-496f-8e68-4700ed7a34bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff2ba976cd947e0a146055f9c8baa9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:17.033042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:17.035351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.042854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:17.061128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 838/1685] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:17.062658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.065628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.075957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 848/1686] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:16 2022] DELETE /identity/v3/users/9ff2ba976cd947e0a146055f9c8baa9f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:17.089501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223607-91d8-470c-95f8-f4a3e2b91a8e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.089786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223607-91d8-470c-95f8-f4a3e2b91a8e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.096994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223607-91d8-470c-95f8-f4a3e2b91a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.226451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-38223607-91d8-470c-95f8-f4a3e2b91a8e None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:17.232672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-38223607-91d8-470c-95f8-f4a3e2b91a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.278800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3235d9-20fa-4f9d-9b55-0719756783ca None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.406154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 849/1687] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:17.407639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.407935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.408193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.451586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.452221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.452503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.452806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.458384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.483281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] MFA Rules not processed for user `53a8aad1e7d34b7c89a3f694cb40261b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:17.484517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.485973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:17.690418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.694286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.713916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 850/1688] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:17.714964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.735889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ac49-8795-4ece-a9bf-d06604806bb9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.753954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 839/1689] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:17.754971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.756237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.758578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.759115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.759461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.762057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:17.762461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.766173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d57071-4c97-43ac-ae2a-c92dbe559a13 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.777041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8ef42-6605-4353-b616-5cdb21c0e1e2 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.788637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.789440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.789734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.790028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.803825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 851/1690] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:17.806341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.806893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.806893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.815463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.816939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.839087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 840/1691] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:17.841181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.868512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] MFA Rules not processed for user `53a8aad1e7d34b7c89a3f694cb40261b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:17.873205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.888494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23486-a17d-4ff2-90c7-aa6e4811a359 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.892088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 852/1692] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:17.912030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.914979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.922246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.923490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.928308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.928723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.929437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.940894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.036736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.048719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 841/1693] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:17 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:18.049807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.074365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d0b6f-92d8-4716-9cdf-209cd21f0d66 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.205256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.208668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.209172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.209664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.234120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25667871-7881-498f-87c9-ad1ee981d606 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.244038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.244950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.245231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.245512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.246230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.251706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.338859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 842/1694] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:18 2022] POST /identity/v3/users => generated 284 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:18.340344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.356206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629311bd-e20c-4ec7-a52e-0c14481ea8d1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.379868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.379868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.379868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.379868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.380194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.389295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.394229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.404320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dca4d-2bfc-497f-b089-ac379e371868 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.434574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 853/1695] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:18.446893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 843/1696] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:18.449790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.471838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c407a-7f5a-4cb7-8603-a951efead8d2 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.482189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.483364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.483629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.498227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.498871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.499186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.499418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.500073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.501739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.542776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 854/1697] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:18.546809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.550748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] MFA Rules not processed for user `bcf8360980c64096ab7187a38895612e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:18.555053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:18.588103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87564-3fc2-4f40-8be5-93588b9bd86c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.612282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.613839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.614122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.614399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] PATH_INFO: `/v3/projects/20c29bce939b414eb1f03548c4395781/users/3305436b124a4ec1899b889fc3e368cb/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.658185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c29bce939b414eb1f03548c4395781, user_id=3305436b124a4ec1899b889fc3e368cb, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.661926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ec31d-f927-4482-a1cb-67b33b5dbc6c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.699530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.717444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 855/1698] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:18 2022] PUT /identity/v3/projects/20c29bce939b414eb1f03548c4395781/users/3305436b124a4ec1899b889fc3e368cb/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:18.727123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.727658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.728092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.800090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 844/1699] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:18.815591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] MFA Rules not processed for user `3305436b124a4ec1899b889fc3e368cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:18.816984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:18.926752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.985395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 856/1700] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:18.990602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.010914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655af7b-458d-4140-8c1e-196e3b31f84a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.136491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.138079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:19.184826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.185602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.185888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.186154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.186889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.189041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.247949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 845/1701] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:18 2022] POST /identity/v3/projects => generated 367 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:19.252920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.321796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593930-f4cb-46a3-8469-1b05a782fb67 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.383520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606b68-ff4d-487a-ab7c-ab7a86c2bd63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.389057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.390683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.391067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.391497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.392459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.396193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.507508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 846/1702] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:19 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:19.508639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.521812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:19.527595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.528259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.530683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.530984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] PATH_INFO: `/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.532927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7876f4d2f2c84851a50d2d5c1951eb42)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.538983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.617556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.655350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7876f4d2f2c84851a50d2d5c1951eb42', 'request_id': 'req-85d51c45-2851-4aed-a52d-78d2a8b6127c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:19.662896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7876f4d2f2c84851a50d2d5c1951eb42', 'request_id': 'req-85d51c45-2851-4aed-a52d-78d2a8b6127c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:19.673422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d44d9-44ff-4b85-aab2-4e9cf1374264 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.675193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7876f4d2f2c84851a50d2d5c1951eb42', 'request_id': 'req-85d51c45-2851-4aed-a52d-78d2a8b6127c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:19.696804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] The token cache is being invalidate because project 7876f4d2f2c84851a50d2d5c1951eb42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:19.697192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:19.698396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-85d51c45-2851-4aed-a52d-78d2a8b6127c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:19.701221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 857/1703] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:19 2022] DELETE /identity/v3/projects/7876f4d2f2c84851a50d2d5c1951eb42 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:19.703219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f6ca-19f0-40fb-94ce-e55e2e6b3b3d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.703644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f6ca-19f0-40fb-94ce-e55e2e6b3b3d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.704274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f6ca-19f0-40fb-94ce-e55e2e6b3b3d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.706486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 858/1704] 10.222.0.26 () {54 vars in 912 bytes} [Mon Aug 8 02:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:19.707070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.707377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.707734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.710628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 859/1705] 10.222.0.26 () {54 vars in 961 bytes} [Mon Aug 8 02:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:19.711671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.714277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:19.782879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.925633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.927489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.927489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.927720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.933567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:19.939858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143636-8b2f-446a-b367-eaf41a6ea54b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.963095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.963977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.964609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.964911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.966256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.970530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75167-59b3-4622-97a0-40df3d219f06 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:20.005842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 860/1706] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:20.009323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7b0-aeb7-4d09-85cd-f44b0e7cc18f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.010675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7b0-aeb7-4d09-85cd-f44b0e7cc18f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.011029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7b0-aeb7-4d09-85cd-f44b0e7cc18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.054802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-faf1d7b0-aeb7-4d09-85cd-f44b0e7cc18f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:20.059030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-faf1d7b0-aeb7-4d09-85cd-f44b0e7cc18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.080764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:20.095527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f365-f94a-4965-978c-e7a927b9cbce service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:20.104948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 861/1707] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:20.104948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.104948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.104948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.123123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 847/1708] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:20.129706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.129706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.134141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.172576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:20.181320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.214532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:20.225220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.399633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 862/1709] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:20.400832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:20.418617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.470999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05144-c612-4773-8c32-c43d1fa42c09 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:20.486982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 848/1710] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Aug 8 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:20.488040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:20.498883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:20.499719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.500138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.500504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] PATH_INFO: `/v3/projects/6f6788cbeea64d248fe5627614d1b88c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.503359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6788cbeea64d248fe5627614d1b88c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:20.507744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:20.541317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca60e56-2e6c-4913-8103-87b1aff2658c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:20.599535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:20.600663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.601375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.602159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] PATH_INFO: `/v3/projects/225dba1e212040819cd87e8d60b1a96d/users/8ff5e7cc4eeb435fb770e1493bf66352/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.637252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225dba1e212040819cd87e8d60b1a96d, user_id=8ff5e7cc4eeb435fb770e1493bf66352, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:20.646403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6788cbeea64d248fe5627614d1b88c', 'request_id': 'req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:20.646959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434b9f0-c885-4b7e-9979-5c98d1d57196 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:20.652991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6788cbeea64d248fe5627614d1b88c', 'request_id': 'req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:20.675501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6788cbeea64d248fe5627614d1b88c', 'request_id': 'req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:20.679694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:20.698964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 849/1711] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:20 2022] PUT /identity/v3/projects/225dba1e212040819cd87e8d60b1a96d/users/8ff5e7cc4eeb435fb770e1493bf66352/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:20.705344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:20.707449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:20.707763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:20.725309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] The token cache is being invalidate because project 6f6788cbeea64d248fe5627614d1b88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:20.727921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:20.730893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:20.734270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 863/1712] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:20 2022] DELETE /identity/v3/projects/6f6788cbeea64d248fe5627614d1b88c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:20.735963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:20.743812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.793238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:20.797099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:20.905479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:20.937044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcf45-3ffd-44d5-afb9-cea7ad223849 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:20.949883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 850/1713] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:20.949883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:20.955447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.073317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.074149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.074537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.074914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.080222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.114537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.116227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.135957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 864/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:21.136987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.143919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.146646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44a7f2-1b44-4d41-be4a-f44078cf91ce None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.153042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.153692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.153966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.154232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.156317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.174193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.176513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.180385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564432-81d9-4d2d-970b-11c9e72be817 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.197013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 851/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:21.197226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.197938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.198330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.198447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.198782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.199544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.201326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dff857-27be-4d7b-a20a-b45c8bc82239 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.204970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.227058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 865/1716] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:21.232746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.233147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.233531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.294066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] MFA Rules not processed for user `c7d5c3d673104612abaa4661edd37401`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:21.294868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece270-a8e2-4f29-83f2-ac913346b30f service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.295552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.306674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.308044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.308320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.308601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] PATH_INFO: `/v3/users/0656f118cf2e41ad8367a3523874559c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.310391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0656f118cf2e41ad8367a3523874559c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.314160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.449302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 866/1717] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:21.450639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.465850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0656f118cf2e41ad8367a3523874559c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:21.491455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0656f118cf2e41ad8367a3523874559c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:21.496669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ce57d-eba4-462e-8851-6cb04a42b37a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.504856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0656f118cf2e41ad8367a3523874559c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:21.506538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0656f118cf2e41ad8367a3523874559c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:21.507486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e126388a-0b59-4d0e-955b-acf082881fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0656f118cf2e41ad8367a3523874559c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:21.542296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 852/1718] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:21 2022] DELETE /identity/v3/users/0656f118cf2e41ad8367a3523874559c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:21.543261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.543516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.543848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.544122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.544794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.545288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.545906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.546774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:21.551765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.553828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.566776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:21.593600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] MFA Rules not processed for user `e536559b9c084a6bafb9d2ce8b493c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:21.595196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.619161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 867/1719] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:21.623327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.635794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.663988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baf715-6c8c-4c9e-b199-bc316c84738a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.728346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 853/1720] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:21.728346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.731914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.885940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.886734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.887088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.890146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] PATH_INFO: `/v3/projects/225dba1e212040819cd87e8d60b1a96d/users/8ff5e7cc4eeb435fb770e1493bf66352/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.898266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225dba1e212040819cd87e8d60b1a96d, user_id=8ff5e7cc4eeb435fb770e1493bf66352, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:21.902881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe56c-d4e8-4bb2-adc7-3299e949d099 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:21.952156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d4c56-a119-4331-b0a8-80445d16c4ec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.964317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 868/1721] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:21 2022] PUT /identity/v3/projects/225dba1e212040819cd87e8d60b1a96d/users/8ff5e7cc4eeb435fb770e1493bf66352/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:21.965848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.970322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.970703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.047463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] MFA Rules not processed for user `8ff5e7cc4eeb435fb770e1493bf66352`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:22.048853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:22.063872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.239655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.240306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.243620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.243910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.244580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.253141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.265363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 869/1722] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:22.277089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.279049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:22.369928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 854/1723] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:22.371100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.487831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1705d-bed9-4264-8c75-a9616095c96f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.489804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.531121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7233-2a6f-4acd-87f0-d0072176cc6b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.550964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.551771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.552061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.552328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.554552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.556601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.622303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 855/1724] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:22 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:22.623240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.631259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.631878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.632160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.632434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.652041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc304e-db60-436c-9592-fa7bff0ea6bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.658246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.659048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.659334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.659722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.660382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.662190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.696114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 856/1725] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:22.697028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.717947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfe5f-ff65-4c10-9b1b-a75c65c57e65 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.733866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.734695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.738462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.739148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.743118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.748129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.779010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 857/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:22.780372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.803480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.808928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.822545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab07e6-5fae-49fe-9f73-f3e568961ec7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.838548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 870/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:22:22.855974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.857405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.863140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.864844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] PATH_INFO: `/v3/projects/64871e7fcb1747f2b654629df3037b60/users/3c34e85925b24565885c54186937e840/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.936041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64871e7fcb1747f2b654629df3037b60, user_id=3c34e85925b24565885c54186937e840, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.939024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b2e48-a6e4-490d-b4b1-8195cd0e5a63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.958214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.968941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2565e-4337-433c-9441-c15be29714f6 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.982097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 858/1728] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:22 2022] PUT /identity/v3/projects/64871e7fcb1747f2b654629df3037b60/users/3c34e85925b24565885c54186937e840/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:22.992733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.994230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.994588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.994945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.032686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] MFA Rules not processed for user `3c34e85925b24565885c54186937e840`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:23.035304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:23.215453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.216885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.217407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.217885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.220427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:23.371562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 859/1729] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:23.395632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.419484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:23.629836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.654551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.713387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 871/1730] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:22:23.714349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.840615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691dd3-172a-4461-a83b-aaaed8c38879 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:23.858271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.859072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.859222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.859516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] PATH_INFO: `/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.869963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630fa9b14b8c4e4e81e69502e7189c8a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.879986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.982743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:24.114043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630fa9b14b8c4e4e81e69502e7189c8a', 'request_id': 'req-c8df349f-b56e-42c4-a026-eb6437347ef5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:24.115829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a980-fa2c-4455-aa8e-22c752e9bb7d service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:24.141588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630fa9b14b8c4e4e81e69502e7189c8a', 'request_id': 'req-c8df349f-b56e-42c4-a026-eb6437347ef5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:24.173623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630fa9b14b8c4e4e81e69502e7189c8a', 'request_id': 'req-c8df349f-b56e-42c4-a026-eb6437347ef5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:24.235930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] The token cache is being invalidate because project 630fa9b14b8c4e4e81e69502e7189c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:24.236237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:24.242481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8df349f-b56e-42c4-a026-eb6437347ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:24.253056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 860/1731] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:23 2022] DELETE /identity/v3/projects/630fa9b14b8c4e4e81e69502e7189c8a => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:24.261713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b688d-a07a-40e6-b4ea-7d30d8917308 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.262010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b688d-a07a-40e6-b4ea-7d30d8917308 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.262289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b688d-a07a-40e6-b4ea-7d30d8917308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.351924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-944b688d-a07a-40e6-b4ea-7d30d8917308 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:24.355460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-944b688d-a07a-40e6-b4ea-7d30d8917308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:24.392467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:24.396005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.396586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.397083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.407821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:24.412217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:24.491143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:24.528636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 872/1732] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:23 2022] POST /identity/v3/projects => generated 383 bytes in 814 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:24.529663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:24.535275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:24.594733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 861/1733] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:24.604799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.604799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.605095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.703514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:24.704810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:24.813318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6aa34-d94e-4e57-8b21-83ba5fd9ad60 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:24.867198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:24.867840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.868127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.868394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.870043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:24.872061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:24.941344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 873/1734] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:24 2022] POST /identity/v3/users => generated 298 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:24.945385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:24.959150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 862/1735] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:24.960509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfebbc-5963-4541-8440-29c2b97850a3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:24.964730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:24.969087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:24.971996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.971996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.974733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.975535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:24.977031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe14e-89d4-4c7c-87bd-450eaa4f4e6e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:24.980841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:24.984047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:24.985187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:24.985543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:24.985860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:24.988146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:24.988461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:24.990609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:25.004828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 874/1736] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:25.008797 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.013665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 863/1737] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:25.019990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.023654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d217-d1d8-41dd-8edd-868c637d3cc5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:25.029728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:25.030505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.030916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.032434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] PATH_INFO: `/v3/projects/4aaa7eb26dce49afbfa96918ba52089f/users/09f61a5c7da34364b7539756ca60e966/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.054007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaa7eb26dce49afbfa96918ba52089f, user_id=09f61a5c7da34364b7539756ca60e966, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:25.057349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:25.062447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f9f7-737c-4a8b-b15c-ea127c58598c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:25.078776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:25.079762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.079939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 875/1738] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:25 2022] PUT /identity/v3/projects/4aaa7eb26dce49afbfa96918ba52089f/users/09f61a5c7da34364b7539756ca60e966/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:25.080738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.083842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.084578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:25.084977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.094837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cc209-1ca3-498a-971a-b7ace1508b76 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:25.172528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 864/1739] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:25.180439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.181429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.182501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.260028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] MFA Rules not processed for user `bcf8360980c64096ab7187a38895612e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:25.263756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:25.279798 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:25.340531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743cac-5e48-4c4b-ab31-d26ae9ef39f5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:25.449120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 865/1740] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:25.450079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.505946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:25.521195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:25.522264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.522737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.523153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.524246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:25.530733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:25.550768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 876/1741] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:25.552333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.565200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9be036-523f-4fc7-9fa5-2ad53b37b767 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:25.570748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:25.571677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.572149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.572566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] PATH_INFO: `/v3/projects/4aaa7eb26dce49afbfa96918ba52089f/users/09f61a5c7da34364b7539756ca60e966/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.575444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaa7eb26dce49afbfa96918ba52089f, user_id=09f61a5c7da34364b7539756ca60e966, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:25.578785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e74549-cf08-4a3b-806c-da8c73f9a672 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:25.609809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 877/1742] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:25 2022] PUT /identity/v3/projects/4aaa7eb26dce49afbfa96918ba52089f/users/09f61a5c7da34364b7539756ca60e966/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:25.620304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bca0e-22e9-4f07-9d83-29ed8bdd3d8f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.620782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bca0e-22e9-4f07-9d83-29ed8bdd3d8f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.621368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bca0e-22e9-4f07-9d83-29ed8bdd3d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.678738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-655bca0e-22e9-4f07-9d83-29ed8bdd3d8f None None] MFA Rules not processed for user `09f61a5c7da34364b7539756ca60e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:25.679866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-655bca0e-22e9-4f07-9d83-29ed8bdd3d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:25.723362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d319f-d6a4-4e73-a708-7dd5202f3586 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:25.843745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 878/1743] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:25.845221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.845511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.845931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.013702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:26.014817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:26.015612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.016392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.016844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.020916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.021883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.026637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.108913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 866/1744] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/users => generated 288 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:26.108913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.115027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:26.185408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 879/1745] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:26.186461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.238465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ffe1-a313-4124-86f5-ba06e8ac8cf3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.250354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.251193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.251792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.252251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.254311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.257691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.282462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 880/1746] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:26.286106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.307159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add50a4a-f84f-43bc-af30-f899835dd411 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.321859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.324025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.324309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.324584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.325278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.332250 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.337052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e8c-7216-4d3b-88d0-b59e540f3e5c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.345311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.346240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.346665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.347140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.358316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.363795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 881/1747] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:26.367197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.384995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.386904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.403976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab11b0-d46e-4a55-aa38-42004efaf917 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.421652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.422256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.422533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.422973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] PATH_INFO: `/v3/projects/b443e0eff88d4029b1b3d33af4faffd5/users/7354b37575924e96ad83b6ea491a4d88/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.426414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 867/1748] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:26.451543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.496267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b443e0eff88d4029b1b3d33af4faffd5, user_id=7354b37575924e96ad83b6ea491a4d88, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.526013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f9079-e40b-4c4e-9b2b-781a345c8f4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.538371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.540680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:26.574835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 882/1749] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:26 2022] PUT /identity/v3/projects/b443e0eff88d4029b1b3d33af4faffd5/users/7354b37575924e96ad83b6ea491a4d88/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:26.587189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.587537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.588126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.696170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] MFA Rules not processed for user `7354b37575924e96ad83b6ea491a4d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:26.698776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:26.844176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4163a7-8437-46fe-bf17-a3788b6533c8 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.894523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 883/1750] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:26.897201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.056220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.057324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.057735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.058139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.175976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd1a5-69c5-4164-94fe-0d21d397236c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.202861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.208931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.209663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.210825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.214962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.228787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.230502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.231549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.266711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 868/1751] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:22:27.357584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 884/1752] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:26 2022] POST /identity/v3/projects => generated 377 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:27.362815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.379302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0db96-d799-44e2-a50b-e6539b473df6 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.441885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:27.745667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.746778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.747295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.747776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.748632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.751846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.874236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 869/1753] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:27 2022] POST /identity/v3/users => generated 295 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:27.876743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.920486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ababdf3-9707-4c9d-9066-7ec17000b1c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.928379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.929334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.929776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.930200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.931030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.934208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.961189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 885/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:27.964106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.980363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f0065-cebd-48bc-9dc6-bdd2beb7b82b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:28.008930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:28.010886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.011178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.013207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] PATH_INFO: `/v3/projects/be073504dfc340189dc87b7577a63cff/users/04ac53031fa143ac8adb392efa0b0405/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.054975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be073504dfc340189dc87b7577a63cff, user_id=04ac53031fa143ac8adb392efa0b0405, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:28.062695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:28.110940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 870/1755] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:27 2022] PUT /identity/v3/projects/be073504dfc340189dc87b7577a63cff/users/04ac53031fa143ac8adb392efa0b0405/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:28.115563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:28.140261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad6c5-569c-4aaa-b955-e66758c3d2e2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:28.323935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:28.368329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:28.369472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.372583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.373932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.378943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:28.413514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63065312-9e18-47e3-922e-b225205eff24 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:28.475125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 886/1756] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:28.480203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:28.516197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27c17-7e1f-4e18-94b2-84804aa4c3f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:28.534455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:28.536414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.539262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.540790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] PATH_INFO: `/v3/projects/be073504dfc340189dc87b7577a63cff/users/04ac53031fa143ac8adb392efa0b0405/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.549305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be073504dfc340189dc87b7577a63cff, user_id=04ac53031fa143ac8adb392efa0b0405, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:28.558922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac66b-d4a2-4547-a2d5-f98bee34d550 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:28.596490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 871/1757] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:28 2022] PUT /identity/v3/projects/be073504dfc340189dc87b7577a63cff/users/04ac53031fa143ac8adb392efa0b0405/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:28.609578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.610206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.610623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.775152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] MFA Rules not processed for user `04ac53031fa143ac8adb392efa0b0405`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:28.776403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:28.837656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18640-1773-400c-a662-59aaec06e7de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.838185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18640-1773-400c-a662-59aaec06e7de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.838740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18640-1773-400c-a662-59aaec06e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.894713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ede18640-1773-400c-a662-59aaec06e7de None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:28.897653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ede18640-1773-400c-a662-59aaec06e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:29.041454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 872/1758] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Aug 8 02:22:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:29.063762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18640-1773-400c-a662-59aaec06e7de None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:29.248140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18640-1773-400c-a662-59aaec06e7de None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:29.258571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:29.260291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:29.261145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:29.261658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] PATH_INFO: `/v3/users/3c34e85925b24565885c54186937e840` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:29.274315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c34e85925b24565885c54186937e840)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:29.277810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:29.305708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 887/1759] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:29.307426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:29.316457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:29.335319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:29.395936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebac8-82f7-4579-83fc-aaeb5c9f158f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:29.421466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:29.422098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:29.422372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:29.427549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:29.427656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c34e85925b24565885c54186937e840'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:29.447959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:29.452420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c34e85925b24565885c54186937e840'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:29.465061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c34e85925b24565885c54186937e840'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:29.466316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c34e85925b24565885c54186937e840'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:29.467669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c34e85925b24565885c54186937e840'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:29.468188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752b4c-bc79-43c6-b05a-22b821ee209c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:29.503003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 873/1760] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:29 2022] DELETE /identity/v3/users/3c34e85925b24565885c54186937e840 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:29.503003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:29.504105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:29.509124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 888/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:29.510770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:29.510994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:29.511271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:29.614312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:29.615742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:29.704920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e01ae-0609-431a-8206-8dd9075681c8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:29.713947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:29.714830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:29.715796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:29.716280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:29.723142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:29.810542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 889/1762] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:29.852488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:29.854847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:29.868877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 874/1763] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:29.964065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:29.966508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:30.163509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406d74-9f07-46ba-b9bd-b9aeed8aa073 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:30.183041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:30.184263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:30.184746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:30.186117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:30.213408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:30.222059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ba3d8-9189-4377-a08e-d94a0870c02f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:30.261809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 890/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:31.737791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.741286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:31.781699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0be67-a045-4acd-98e3-79d67a7b7292 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.796206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.797533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.798122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.798752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] PATH_INFO: `/v3/users/3305436b124a4ec1899b889fc3e368cb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.803755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3305436b124a4ec1899b889fc3e368cb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.806910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:31.952455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3305436b124a4ec1899b889fc3e368cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:31.962112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:31.972056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3305436b124a4ec1899b889fc3e368cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:31.989610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3305436b124a4ec1899b889fc3e368cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:32.018563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3305436b124a4ec1899b889fc3e368cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:32.022503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3305436b124a4ec1899b889fc3e368cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:32.063912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 875/1765] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:31 2022] DELETE /identity/v3/users/3305436b124a4ec1899b889fc3e368cb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:32.069092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.069986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.070495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.087640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:32.096986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:32.099684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:32.219678 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 891/1766] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:32.623254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.625091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:32.874835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9e6a-4413-4a8b-911d-7635996d4eb1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.893189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.893887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.894158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.894430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.909529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.912968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.924556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 876/1767] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:33.438114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:33.456257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:33.498687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547df5-79ad-4d78-9524-8d327baf9cc9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:33.518140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:33.519077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:33.519520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:33.519989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] PATH_INFO: `/v3/projects/64871e7fcb1747f2b654629df3037b60` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:33.521474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64871e7fcb1747f2b654629df3037b60)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:33.526679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:33.647031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64871e7fcb1747f2b654629df3037b60', 'request_id': 'req-50b4199c-1fae-4a75-85dd-1231a128e423'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:33.660095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64871e7fcb1747f2b654629df3037b60', 'request_id': 'req-50b4199c-1fae-4a75-85dd-1231a128e423'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:33.675430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64871e7fcb1747f2b654629df3037b60', 'request_id': 'req-50b4199c-1fae-4a75-85dd-1231a128e423'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:33.703437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] The token cache is being invalidate because project 64871e7fcb1747f2b654629df3037b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:33.704137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:33.708019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-50b4199c-1fae-4a75-85dd-1231a128e423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:33.711223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 892/1768] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:33 2022] DELETE /identity/v3/projects/64871e7fcb1747f2b654629df3037b60 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:33.714879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:33.738683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5f6-eb14-4dc4-a6e2-10e268770c07 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:33.810425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:33.810830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:33.811307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:33.814799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 893/1769] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:22:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:22:33.946940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:33.948202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:33.950226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:33.951892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] PATH_INFO: `/v3/users/09f61a5c7da34364b7539756ca60e966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:33.968389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:33.970204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:33.977632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f61a5c7da34364b7539756ca60e966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:33.984034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:34.093668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa130d9d-106a-435c-b5ec-5b8d1a200e74 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:34.113128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:34.113703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:34.113987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:34.114259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:34.116110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:34.137438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f61a5c7da34364b7539756ca60e966'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:34.150948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f61a5c7da34364b7539756ca60e966'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:34.170341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f61a5c7da34364b7539756ca60e966'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:34.172565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f61a5c7da34364b7539756ca60e966'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:34.177205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7b30aa2c-9589-4a42-81d5-757f9cf3db8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f61a5c7da34364b7539756ca60e966'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:34.199440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:34.221676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 877/1770] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:33 2022] DELETE /identity/v3/users/09f61a5c7da34364b7539756ca60e966 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:34.223871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:34.224324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:34.224795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:34.250701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:34.254457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:34.256603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:34.306905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:34.311824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:34.348462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 894/1771] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:34.421304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 878/1772] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:34.617450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:34.619625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:34.941058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416f61-334e-48bf-aa29-7e01b4120f99 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:34.978751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:34.979387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:34.979729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:34.979932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.022358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:35.023724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:35.088681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 895/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:36.178151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.180181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:36.190115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.193290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:36.400968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3950-9e87-4771-bd51-a4d64e96181f service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.418788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.422070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.422381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.428731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] PATH_INFO: `/v3/projects/4aaa7eb26dce49afbfa96918ba52089f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.434018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaa7eb26dce49afbfa96918ba52089f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.445902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.463609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c8ac1-4f6e-490e-a799-10aea55f1771 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.484284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.485069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.485344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.486236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] PATH_INFO: `/v3/projects/20c29bce939b414eb1f03548c4395781` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.489409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c29bce939b414eb1f03548c4395781)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.503606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.638961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaa7eb26dce49afbfa96918ba52089f', 'request_id': 'req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.660038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaa7eb26dce49afbfa96918ba52089f', 'request_id': 'req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.690485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaa7eb26dce49afbfa96918ba52089f', 'request_id': 'req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.693614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:36.736477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] The token cache is being invalidate because project 4aaa7eb26dce49afbfa96918ba52089f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:36.736477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.737245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9dd959bb-e2ba-46bf-8b1e-d93ceb39bcea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.747136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 896/1774] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:36 2022] DELETE /identity/v3/projects/4aaa7eb26dce49afbfa96918ba52089f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:36.748538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04d86-9882-41d4-86df-bf812dcb592b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.748881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04d86-9882-41d4-86df-bf812dcb592b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.749133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04d86-9882-41d4-86df-bf812dcb592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.753757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c29bce939b414eb1f03548c4395781', 'request_id': 'req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.778477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c29bce939b414eb1f03548c4395781', 'request_id': 'req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.790799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c29bce939b414eb1f03548c4395781', 'request_id': 'req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.810113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] The token cache is being invalidate because project 20c29bce939b414eb1f03548c4395781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:36.810443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.812829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:36.844097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 879/1775] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:36 2022] DELETE /identity/v3/projects/20c29bce939b414eb1f03548c4395781 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:36.846758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6fb04d86-9882-41d4-86df-bf812dcb592b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:36.848369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.849892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6fb04d86-9882-41d4-86df-bf812dcb592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:36.856869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:36.889551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:37.053375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 897/1776] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:37.070447 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.070876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.071311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.127629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd959f-caa6-47f8-8b7c-5b1d9e278815 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.151200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.153937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:37.154446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.154710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.155344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] PATH_INFO: `/v3/users/8ff5e7cc4eeb435fb770e1493bf66352` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.162892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff5e7cc4eeb435fb770e1493bf66352)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.169097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.173510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:37.208132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 898/1777] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:37.213009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.241742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef5103-29bb-4fee-8a7c-32d66984d7a0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.253964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.255673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.256942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.257982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.259983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:37.260291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.264287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.306955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 899/1778] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:37.308940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.313609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff5e7cc4eeb435fb770e1493bf66352'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:37.337151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff5e7cc4eeb435fb770e1493bf66352'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:37.338306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2489f-9dc6-49d4-b692-21728a39f12d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.354951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.355436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.355717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.355988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.356734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.358807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff5e7cc4eeb435fb770e1493bf66352'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:37.359035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.360567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff5e7cc4eeb435fb770e1493bf66352'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:37.361885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff5e7cc4eeb435fb770e1493bf66352'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:37.397450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 880/1779] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:36 2022] DELETE /identity/v3/users/8ff5e7cc4eeb435fb770e1493bf66352 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:37.443086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 900/1780] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:37 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:37.444272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.445996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:37.559995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232d32-3d0b-4435-8af1-9be6a3d9c5e5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.611516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:37.651706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.652490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.653125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.653461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.654377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.658191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.689929 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 881/1781] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:37 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:37.693780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.708991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e273-894c-41ac-b9fb-88686a574b51 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.715248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.716188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.716525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.716944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.717669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.719780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.753433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 901/1782] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:37.758840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.776709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373b30-4a26-4b3e-833e-c7125cd7dead admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.784833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.785694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.786039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.786544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.787282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.790197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca1e1b-eb99-4af7-98b3-655ffc5a7319 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.812323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 882/1783] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:37.817827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.838427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e56537-daf9-4c11-9e2f-011fbc427fce admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.858038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.858985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.859387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.859789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] PATH_INFO: `/v3/projects/44984c388c60475cb89a4ce392dd3eaf/users/78c6a2ee0fed47829ad58b32eeba5e87/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.892855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=44984c388c60475cb89a4ce392dd3eaf, user_id=78c6a2ee0fed47829ad58b32eeba5e87, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.900481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.951694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 902/1784] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:37 2022] PUT /identity/v3/projects/44984c388c60475cb89a4ce392dd3eaf/users/78c6a2ee0fed47829ad58b32eeba5e87/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:37.962161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.962793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.963435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:38.053436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] MFA Rules not processed for user `78c6a2ee0fed47829ad58b32eeba5e87`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:38.055980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:38.242046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 883/1785] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:38.299922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:38.301994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:38.487457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7942541-fdd2-4078-a3c8-36990f09a7ad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:38.510734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:38.512287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:38.514617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:38.515065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:38.546831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:38.552210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95742-3c59-494c-bbc3-3f8fc1cbda36 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:38.607372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 903/1786] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:40.311493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.317908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:40.481807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533bd7-9e87-47a0-85d4-39aebfb81087 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.494291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.495405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.495777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.496133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] PATH_INFO: `/v3/projects/225dba1e212040819cd87e8d60b1a96d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.498016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=225dba1e212040819cd87e8d60b1a96d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.500220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.571442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.582332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225dba1e212040819cd87e8d60b1a96d', 'request_id': 'req-046cd2cd-8746-4f42-90f2-9e89675984ee'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:40.607882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225dba1e212040819cd87e8d60b1a96d', 'request_id': 'req-046cd2cd-8746-4f42-90f2-9e89675984ee'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:40.624152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225dba1e212040819cd87e8d60b1a96d', 'request_id': 'req-046cd2cd-8746-4f42-90f2-9e89675984ee'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:40.645028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] The token cache is being invalidate because project 225dba1e212040819cd87e8d60b1a96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:40.645275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:40.646053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-046cd2cd-8746-4f42-90f2-9e89675984ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:40.648709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 884/1787] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:40 2022] DELETE /identity/v3/projects/225dba1e212040819cd87e8d60b1a96d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:40.653208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5dee4-7a51-4cfe-a1c5-8ffc411869c3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.653704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5dee4-7a51-4cfe-a1c5-8ffc411869c3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.653879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5dee4-7a51-4cfe-a1c5-8ffc411869c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.692538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95a5dee4-7a51-4cfe-a1c5-8ffc411869c3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:40.694282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95a5dee4-7a51-4cfe-a1c5-8ffc411869c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:40.751274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.808849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77650-66bf-4573-91af-2fd1149dd2cf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.809155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77650-66bf-4573-91af-2fd1149dd2cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.809419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77650-66bf-4573-91af-2fd1149dd2cf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.810955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 885/1788] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:40.811317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 904/1789] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:40.819298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.819618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.819859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.841998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:40.843976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:40.848574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.850139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.851796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.854294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 886/1790] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:40.859674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.871187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecde0-17cd-41b7-9653-c5fd9f90479d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.884994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.884994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.884994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.884994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.885601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:40.885601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.892104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.912340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 887/1791] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:40.913032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:40.914280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:40.916732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.932128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a71f-9d53-487b-817d-5abceb3e66b7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.953039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.953718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.954362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.955200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.955886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.958465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.997383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 888/1792] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:40 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:40.997383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.997383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.015119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 905/1793] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:22:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:41.015988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.027476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9564d97-5e6e-443a-9899-d7b9a801e14a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.066291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870cac-2632-4fd1-b1dd-28077e6a0a7d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.071339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.072014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.072295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.072565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] PATH_INFO: `/v3/users/65e72cc28cf44889b13f57326f61e13a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.074068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e72cc28cf44889b13f57326f61e13a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.075985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.115670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.116694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.117190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.118062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.118907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.121860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.130122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e72cc28cf44889b13f57326f61e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:41.139572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e72cc28cf44889b13f57326f61e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:41.148474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 906/1794] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:41 2022] POST /identity/v3/users => generated 301 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:41.149277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.152304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.152434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e72cc28cf44889b13f57326f61e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:41.153255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e72cc28cf44889b13f57326f61e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:41.153905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e72cc28cf44889b13f57326f61e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:41.176171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 889/1795] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:40 2022] DELETE /identity/v3/users/65e72cc28cf44889b13f57326f61e13a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:41.176171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.176171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.198102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:41.219922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:41.265424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec5ac4-90d8-445e-ba78-888f5079fcd1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.294994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357b382-3c77-4199-8a51-a9369251c182 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.302229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.303019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.304320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.304675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.305796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.307759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1d65-e9c6-451a-b93d-7e68cc8e6795 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.330354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 890/1796] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:41.331279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.331279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.331279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.357131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:41.358405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.368776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 891/1797] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:41.369656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.375569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.376404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.377533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.380209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.380358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb383e-4de9-457f-a330-f2b677346087 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.380824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.384775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.385389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.385668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.385941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.386587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.388194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.396527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.399230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.399662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 892/1798] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:41.400247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.404567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.420875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 907/1799] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:41.422152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.441885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7deec4-4469-48e6-934a-07b0f7bb414a service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.455532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.456404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.457382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.457839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] PATH_INFO: `/v3/projects/00ab7fc9f61e4311a2b58591c9b06025/users/467af1cb8acb46578360843a642776b2/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.478916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ab7fc9f61e4311a2b58591c9b06025, user_id=467af1cb8acb46578360843a642776b2, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.482062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316546b2-472c-4649-9e7b-f11fa1f1c0b3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.491655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2534e-fbad-4569-bd1d-e1dfb304e2f8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.496367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.499707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.499999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.500275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.509014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 908/1800] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:41 2022] PUT /identity/v3/projects/00ab7fc9f61e4311a2b58591c9b06025/users/467af1cb8acb46578360843a642776b2/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:41.514415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.514697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.514967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.529841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.533781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.545887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 893/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:41.557661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] MFA Rules not processed for user `467af1cb8acb46578360843a642776b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:41.558964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.640133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 909/1802] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:41.644855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.655201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c69f-6fe7-4094-9934-ac9f566b868e service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.724475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.725171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.725453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.725779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.726405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.728696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.762395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 894/1803] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:41 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:41.766749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.796262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641c907-a883-4538-a490-18f7721d69d5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.868093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:41.934499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.935981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.936476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.937394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.939098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.941507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:41.946822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.952917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.963174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9caf3f-8fdd-48a6-ad53-ef761a7d1b67 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.972876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.972876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.973055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.973315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] PATH_INFO: `/v3/projects/a729916906a34eb88afc57924d866a46` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.974524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a729916906a34eb88afc57924d866a46)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.976775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.993448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:42.000859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 910/1804] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:41 2022] POST /identity/v3/users => generated 307 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:42.003301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.025661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526decfc-7cc6-4f1d-bf23-8d70c383bf75 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.040727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a729916906a34eb88afc57924d866a46', 'request_id': 'req-9f050758-979f-4c8f-af5d-32e1630d8378'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.047298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a729916906a34eb88afc57924d866a46', 'request_id': 'req-9f050758-979f-4c8f-af5d-32e1630d8378'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.061752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a729916906a34eb88afc57924d866a46', 'request_id': 'req-9f050758-979f-4c8f-af5d-32e1630d8378'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.083977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] The token cache is being invalidate because project a729916906a34eb88afc57924d866a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:42.088516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.101332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.106034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 895/1805] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:41 2022] DELETE /identity/v3/projects/a729916906a34eb88afc57924d866a46 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:42.107227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.108778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.133993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.134611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.134896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.135199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.135822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.137517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.148283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 911/1806] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:42.152244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.155651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.172131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ffecd-3069-48b0-98b2-57ce5b2fc87f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.177982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.178967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.179175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.179908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] PATH_INFO: `/v3/projects/7670fa03d79547e7bb8222cb59866b08/users/7964a0e1cbd24f25bc2e956657ec0b08/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.198012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050758-979f-4c8f-af5d-32e1630d8378 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.199038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7670fa03d79547e7bb8222cb59866b08, user_id=7964a0e1cbd24f25bc2e956657ec0b08, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.201782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.203077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.203714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.204025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.204267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] PATH_INFO: `/v3/users/efec3a5032534148842d3ae80a784779` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.206431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efec3a5032534148842d3ae80a784779)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.208300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.217884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 912/1807] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:42 2022] PUT /identity/v3/projects/7670fa03d79547e7bb8222cb59866b08/users/7964a0e1cbd24f25bc2e956657ec0b08/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:42.223304 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.279856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efec3a5032534148842d3ae80a784779'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.292077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efec3a5032534148842d3ae80a784779'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.302147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efec3a5032534148842d3ae80a784779'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.315408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efec3a5032534148842d3ae80a784779'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.318367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-06518bdb-7c7a-4c0d-b22a-dc0ffcfd3d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efec3a5032534148842d3ae80a784779'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:42.320619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7b5d-acc7-4f22-af83-611288d05f0e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.326897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.327520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.327799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.328085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.328763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.332812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.348559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 913/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:42.349498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.351888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.353347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 896/1809] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:42 2022] DELETE /identity/v3/users/efec3a5032534148842d3ae80a784779 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:42.366672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9e66-4d51-4702-a51c-9a16acdb9185 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.411852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:42.474136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.474971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.475355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.475730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] PATH_INFO: `/v3/projects/7670fa03d79547e7bb8222cb59866b08/users/7964a0e1cbd24f25bc2e956657ec0b08/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.479583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7670fa03d79547e7bb8222cb59866b08, user_id=7964a0e1cbd24f25bc2e956657ec0b08, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.488005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.503730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 914/1810] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:42 2022] PUT /identity/v3/projects/7670fa03d79547e7bb8222cb59866b08/users/7964a0e1cbd24f25bc2e956657ec0b08/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:42.515489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.515779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.516083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.580815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] MFA Rules not processed for user `7964a0e1cbd24f25bc2e956657ec0b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:42.584382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.603809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:42.682864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 897/1811] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:42 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:42.694836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.696596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.764694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1136d34-26aa-4601-8765-efd0ae4ef244 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.769873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.770642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.771251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.771251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.789660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:42.791396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:42.803734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 915/1812] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:42.901352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:42.903046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:42.948605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b0c9-f5fe-4552-9ea9-8496a8f6d5c2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:42.952930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:42.953356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:42.953656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:42.953908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:42.957208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:43.051595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.058988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabea10-e3ea-4941-ba71-456a0fb2aafe service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.063033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 898/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:43.130883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.132763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:43.277692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb407f15-1182-4147-8ea8-93dcfd405365 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.292968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.294802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.295233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.295611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] PATH_INFO: `/v3/projects/c8876a82609a49cd81e724306658a9d7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.298045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8876a82609a49cd81e724306658a9d7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.303319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.370480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8876a82609a49cd81e724306658a9d7', 'request_id': 'req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:43.378662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8876a82609a49cd81e724306658a9d7', 'request_id': 'req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:43.387301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8876a82609a49cd81e724306658a9d7', 'request_id': 'req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:43.397808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:43.405424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] The token cache is being invalidate because project c8876a82609a49cd81e724306658a9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:43.405904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:43.406875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c4b47019-8c4d-4b7a-b139-ffc4d80f3ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:43.409486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 916/1814] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:43 2022] DELETE /identity/v3/projects/c8876a82609a49cd81e724306658a9d7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:43.415050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.415551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.415551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.437340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:43.438665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:43.539871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 899/1815] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:43.547791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.548078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.548414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.577836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:43.578983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:43.589858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 917/1816] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:43.594228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.606817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4ea32-3120-408e-b233-ad36a3830389 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.623494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.624244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.624590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.624982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.625725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:43.626095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.628704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.642917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 900/1817] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:43.647081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.656871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fe5f2-2033-4455-9b01-3576a6b69483 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.661924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.662377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.662656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.662926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.663759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.665762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.703261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 918/1818] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:43.708529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.721484 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4b9f-ff6b-4bd3-8f87-1375e0d03799 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.760764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:43.799725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.800416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.800808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.801306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.801907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.803908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.826983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 901/1819] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:43.831052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.841877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6190-b95d-49b4-bfee-62fd98931b32 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.846600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.847197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.847476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.847751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.848503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.850239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.860343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 919/1820] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:22:43.864758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.874602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff07d1-6bb4-49a4-8ba4-a969e1e233af admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.879646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.880240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.880520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.880827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.881465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.883064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20fd4e-1d87-44d4-918c-cd6649450fe9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.893828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 902/1821] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:22:43.898157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.909376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3222f-7497-451d-b335-31d78238d5c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.914434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.915115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.915389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.915659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] PATH_INFO: `/v3/projects/fd0883534fd84cc8b0fb4486e0812af6/users/9eb35f76693f4dda89a6a71ddd7625f1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.931872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0883534fd84cc8b0fb4486e0812af6, user_id=9eb35f76693f4dda89a6a71ddd7625f1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.934754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.949889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 920/1822] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:43 2022] PUT /identity/v3/projects/fd0883534fd84cc8b0fb4486e0812af6/users/9eb35f76693f4dda89a6a71ddd7625f1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:43.962386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.962673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.962944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.992425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] MFA Rules not processed for user `9eb35f76693f4dda89a6a71ddd7625f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:43.993701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:44.066500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 903/1823] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:44.071301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.135974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20196-6191-4de4-9b82-832f84f6b5ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.141469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.143151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.143582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.143861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.144493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.146578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.176565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 921/1824] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:44 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:44.181263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.193238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4df6-e66a-4602-b695-190f3e547323 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.259109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.259853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.260158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.260427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.261229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.263112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.285768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 904/1825] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:44 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:44.289845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.301429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec36bb-78a4-4900-b73e-c55507b10d3c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.306187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.306874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.307155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.307421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.308059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.309671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.322920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 922/1826] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:44.327223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.338607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeed37-c179-48a0-973d-d8e9863f0b56 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.343417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.344078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.344360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.344678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] PATH_INFO: `/v3/projects/d41d38a326dd4049a72d408c67721e0c/users/a9fe5d305dc04ca8a854e2f095105f0b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.362221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41d38a326dd4049a72d408c67721e0c, user_id=a9fe5d305dc04ca8a854e2f095105f0b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.364895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.378749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 905/1827] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:44 2022] PUT /identity/v3/projects/d41d38a326dd4049a72d408c67721e0c/users/a9fe5d305dc04ca8a854e2f095105f0b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:44.383440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.395121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e5c9d-3e84-4048-b130-7632e843daff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.458337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.458949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.459317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.459532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.460243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.462288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125757f-7bc4-4994-afb8-b65e85940e01 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.474043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 923/1828] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:44.482015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.490728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:44.495252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ff5b-3a39-428a-bb88-81fae9cae624 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.503656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.504501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.504928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.505276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] PATH_INFO: `/v3/projects/d41d38a326dd4049a72d408c67721e0c/users/a9fe5d305dc04ca8a854e2f095105f0b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.509464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41d38a326dd4049a72d408c67721e0c, user_id=a9fe5d305dc04ca8a854e2f095105f0b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.512194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.524080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 906/1829] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:44 2022] PUT /identity/v3/projects/d41d38a326dd4049a72d408c67721e0c/users/a9fe5d305dc04ca8a854e2f095105f0b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:44.534803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.535133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.535441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.544209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:44.567318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] MFA Rules not processed for user `a9fe5d305dc04ca8a854e2f095105f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:44.568396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:44.646185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 924/1830] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:44.665751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.667751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:44.746988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be0e3-84d2-4627-8b51-432b1a821e4a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.751797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.752579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.752897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.753172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.764676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.766092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.776925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 907/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:44.877536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.878323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.879732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:44.880316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:44.905365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142d4b-1303-475d-8203-fded672974e1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.921715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.922349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.922628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.922900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.975196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf080-b0c2-4011-869d-00de2809af41 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.982113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.982965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.983308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.983649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] PATH_INFO: `/v3/users/78c6a2ee0fed47829ad58b32eeba5e87` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.985598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c6a2ee0fed47829ad58b32eeba5e87)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.989562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.005612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:45.007215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8a73d-c793-48a7-be9a-ceaaad6469f3 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.018915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 925/1832] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:45.059501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c6a2ee0fed47829ad58b32eeba5e87'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.068918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c6a2ee0fed47829ad58b32eeba5e87'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.079088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c6a2ee0fed47829ad58b32eeba5e87'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.081167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c6a2ee0fed47829ad58b32eeba5e87'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.082200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c6a2ee0fed47829ad58b32eeba5e87'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.112735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 908/1833] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:44 2022] DELETE /identity/v3/users/78c6a2ee0fed47829ad58b32eeba5e87 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:45.115649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.116084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.116607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.143633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:45.147253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:45.232029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 926/1834] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:45.242588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:45.244385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:45.263395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:45.314833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7f4f-a7a4-431a-8981-d330b778701f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:45.318404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:45.319001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.319297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.319538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.328193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:45.329682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed640ca9-066f-457b-9f25-1d399d9a0c1b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.338811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 909/1835] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:45.610323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:45.613168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:45.630192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2127d2-64c7-4c90-815e-f21f138d30b2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:45.634933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:45.635570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.635849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.636118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] PATH_INFO: `/v3/projects/44984c388c60475cb89a4ce392dd3eaf` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.637266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44984c388c60475cb89a4ce392dd3eaf)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:45.639163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.668102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:45.697747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44984c388c60475cb89a4ce392dd3eaf', 'request_id': 'req-4d794a43-10dd-485b-866f-ecd03fae3fa2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.710057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44984c388c60475cb89a4ce392dd3eaf', 'request_id': 'req-4d794a43-10dd-485b-866f-ecd03fae3fa2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.718935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44984c388c60475cb89a4ce392dd3eaf', 'request_id': 'req-4d794a43-10dd-485b-866f-ecd03fae3fa2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.731564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] The token cache is being invalidate because project 44984c388c60475cb89a4ce392dd3eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:45.731848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.732551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4d794a43-10dd-485b-866f-ecd03fae3fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:45.734263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 927/1836] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:45 2022] DELETE /identity/v3/projects/44984c388c60475cb89a4ce392dd3eaf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:45.739680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.740151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.740284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.761288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:45.762519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:45.828371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 910/1837] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:45.837719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.838001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.838273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.860199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:45.862443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:45.870969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 928/1838] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:45.875227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:45.885814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb84bd-39c9-4c82-a140-beb4d2462603 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:45.890423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:45.891059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.891336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.891626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.892267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:45.892570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:45.894209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.910229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 911/1839] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:45.914496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:45.928132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b30473-49ab-4018-bf62-fd7a0e190713 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:45.934393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:45.935014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:45.935289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:45.935806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:45.936443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:45.940396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:45.982840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 929/1840] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:45 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:45.987711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.000263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188751ec-0286-447d-b40b-0317867db1ed admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.081731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.082361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.082641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.082908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.083548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.085616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.109690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 912/1841] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:45 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:46.115321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.137047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8ba7-cd54-4506-b7e4-ec0a8541b1e5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.140919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.141917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.142203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.142480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.143140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.145568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.162214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 930/1842] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:22:46.163520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.174867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6714-3309-4f06-8bf3-ce9cb87cb76e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.181141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.182168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.182704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.183365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.184263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.185834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9ebb-937f-41c9-8cd2-18e786d7d4c3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.200849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 913/1843] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:46.202321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.217094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789d75-80f4-45b7-92c7-050b8944ccf1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.224110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.224830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.225159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.225440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] PATH_INFO: `/v3/projects/4352832f335c41129c80acdb52a3ced2/users/1b8cc24e75d4496e891af4e2df51ed0d/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.250121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4352832f335c41129c80acdb52a3ced2, user_id=1b8cc24e75d4496e891af4e2df51ed0d, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.252968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.282308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 931/1844] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:46 2022] PUT /identity/v3/projects/4352832f335c41129c80acdb52a3ced2/users/1b8cc24e75d4496e891af4e2df51ed0d/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:46.294124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.294680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.295536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.353419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] MFA Rules not processed for user `1b8cc24e75d4496e891af4e2df51ed0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:46.355156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:46.369079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:46.467705 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 914/1845] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:46.480431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.482192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:46.581312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a392ad-cf32-4edf-af1b-0c71003b3f43 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.585320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.585933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.586208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.586479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.596464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.598083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8d9d9-0023-478a-aa92-3ae5bcb85b21 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.607505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 932/1846] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:47.611134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:47.613538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:47.696486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c879-9ea2-48a8-a4e5-15e4e50d40e2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:47.701613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:47.702244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:47.702517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:47.702807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] PATH_INFO: `/v3/users/467af1cb8acb46578360843a642776b2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:47.703910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=467af1cb8acb46578360843a642776b2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:47.706519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:47.755654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467af1cb8acb46578360843a642776b2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:47.763839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467af1cb8acb46578360843a642776b2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:47.772304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467af1cb8acb46578360843a642776b2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:47.772918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467af1cb8acb46578360843a642776b2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:47.773538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467af1cb8acb46578360843a642776b2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:47.792736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 915/1847] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:47 2022] DELETE /identity/v3/users/467af1cb8acb46578360843a642776b2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:47.797528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:47.798083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:47.798165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:47.820513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:47.821841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:47.877485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:47.894597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 933/1848] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:47.904357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:47.905813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:47.942093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:47.943473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:47.943623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:47.956799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfca2a-98da-4c35-b9fe-e02076d19410 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:47.961737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:47.962428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:47.962708 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:47.962974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] PATH_INFO: `/v3/users/9eb35f76693f4dda89a6a71ddd7625f1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:47.964206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb35f76693f4dda89a6a71ddd7625f1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:47.966195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:47.973823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c091-f215-47af-a975-b6df98840a1e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:47.977887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:47.978508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:47.978837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:47.979116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:47.990270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:47.991830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10630a-c2b2-4419-bc47-601459d3170a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.004261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 916/1849] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:48.027446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb35f76693f4dda89a6a71ddd7625f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.038712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb35f76693f4dda89a6a71ddd7625f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.039740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb35f76693f4dda89a6a71ddd7625f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.040635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb35f76693f4dda89a6a71ddd7625f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.050010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb35f76693f4dda89a6a71ddd7625f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.072499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 934/1850] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:47 2022] DELETE /identity/v3/users/9eb35f76693f4dda89a6a71ddd7625f1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:48.078388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.078992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.080022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.103551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:48.104802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:48.182281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 917/1851] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:48.223123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.224593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:48.334621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c83a3-0107-4801-a61e-9f8db87f0844 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.338912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.339549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.340009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.340240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.353401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.355066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.369827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 935/1852] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:48.433199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.434899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:48.454074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154183-acb5-4109-ae0a-c4690df24c95 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.460860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.461470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.462315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.462427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] PATH_INFO: `/v3/projects/00ab7fc9f61e4311a2b58591c9b06025` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.464509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ab7fc9f61e4311a2b58591c9b06025)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.466715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.586932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ab7fc9f61e4311a2b58591c9b06025', 'request_id': 'req-64304c90-dbd6-4238-b64c-2193357b2b5f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.605424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ab7fc9f61e4311a2b58591c9b06025', 'request_id': 'req-64304c90-dbd6-4238-b64c-2193357b2b5f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.630826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ab7fc9f61e4311a2b58591c9b06025', 'request_id': 'req-64304c90-dbd6-4238-b64c-2193357b2b5f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.669225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] The token cache is being invalidate because project 00ab7fc9f61e4311a2b58591c9b06025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:48.669866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.674344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.677034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 918/1853] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:48 2022] DELETE /identity/v3/projects/00ab7fc9f61e4311a2b58591c9b06025 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:48.683277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.698389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c09-6e99-43b8-a922-d02159648ca5 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.826437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.827163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.827560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.827864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] PATH_INFO: `/v3/users/7964a0e1cbd24f25bc2e956657ec0b08` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.829271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7964a0e1cbd24f25bc2e956657ec0b08)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.831315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.839091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:48.923449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7964a0e1cbd24f25bc2e956657ec0b08'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.934357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7964a0e1cbd24f25bc2e956657ec0b08'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.935869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7964a0e1cbd24f25bc2e956657ec0b08'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.936605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7964a0e1cbd24f25bc2e956657ec0b08'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.947092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7964a0e1cbd24f25bc2e956657ec0b08'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:48.969919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 936/1854] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:48 2022] DELETE /identity/v3/users/7964a0e1cbd24f25bc2e956657ec0b08 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:49.244365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:49.246081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:49.265709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304c90-dbd6-4238-b64c-2193357b2b5f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:49.346496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:49.356066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:49.357519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:49.357914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:49.358848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] PATH_INFO: `/v3/projects/fd0883534fd84cc8b0fb4486e0812af6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:49.360234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0883534fd84cc8b0fb4486e0812af6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:49.365087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:49.442474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0883534fd84cc8b0fb4486e0812af6', 'request_id': 'req-e938fc7e-e860-4c66-942a-195f8ec9241a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.459288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0883534fd84cc8b0fb4486e0812af6', 'request_id': 'req-e938fc7e-e860-4c66-942a-195f8ec9241a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.472485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0883534fd84cc8b0fb4486e0812af6', 'request_id': 'req-e938fc7e-e860-4c66-942a-195f8ec9241a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.493638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] The token cache is being invalidate because project fd0883534fd84cc8b0fb4486e0812af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:49.494120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.495346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.500938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:49.501182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 919/1855] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:49 2022] DELETE /identity/v3/projects/fd0883534fd84cc8b0fb4486e0812af6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:49.503055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:49.522108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c039523-b121-4a8c-b0b5-f0a63faa5abb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:49.617646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:49.619729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:49.688311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:49.689446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:49.690459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:49.691255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] PATH_INFO: `/v3/users/a9fe5d305dc04ca8a854e2f095105f0b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:49.702063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fe5d305dc04ca8a854e2f095105f0b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:49.706506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:49.730102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938fc7e-e860-4c66-942a-195f8ec9241a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:49.736242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:49.737157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:49.737497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:49.737873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] PATH_INFO: `/v3/users/7354b37575924e96ad83b6ea491a4d88` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:49.739528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7354b37575924e96ad83b6ea491a4d88)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:49.748945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:49.802992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fe5d305dc04ca8a854e2f095105f0b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.817138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fe5d305dc04ca8a854e2f095105f0b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.818027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fe5d305dc04ca8a854e2f095105f0b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.819205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fe5d305dc04ca8a854e2f095105f0b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.826885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7354b37575924e96ad83b6ea491a4d88'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.829515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fe5d305dc04ca8a854e2f095105f0b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.841577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7354b37575924e96ad83b6ea491a4d88'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.851268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 937/1856] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:49 2022] DELETE /identity/v3/users/a9fe5d305dc04ca8a854e2f095105f0b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:49.852819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:49.856043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:49.873948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:49.877952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7354b37575924e96ad83b6ea491a4d88'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.880774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7354b37575924e96ad83b6ea491a4d88'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.883494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ecd66b34-524e-4e3c-82b9-2bffc9009df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7354b37575924e96ad83b6ea491a4d88'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:49.932621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 920/1857] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:49 2022] DELETE /identity/v3/users/7354b37575924e96ad83b6ea491a4d88 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:49.937263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6b1e-46a0-453d-be8e-188babe2defe None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:49.937618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6b1e-46a0-453d-be8e-188babe2defe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:49.937973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6b1e-46a0-453d-be8e-188babe2defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:49.963393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:49.972747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cf3d6b1e-46a0-453d-be8e-188babe2defe None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:49.974206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf3d6b1e-46a0-453d-be8e-188babe2defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.029310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea7b1-c8b8-4828-9ecf-2db164e9a2a5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.102116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 921/1858] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.104000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.104673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.105021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.107280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 922/1859] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:22:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:50.108454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.111163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.125837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.127661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.128163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.128624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] PATH_INFO: `/v3/projects/7670fa03d79547e7bb8222cb59866b08` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.133066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fef7-3f50-451f-9277-59a144150f42 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.143339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.144086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.144590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.144997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] PATH_INFO: `/v3/users/1b8cc24e75d4496e891af4e2df51ed0d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.145432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7670fa03d79547e7bb8222cb59866b08)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.146465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8cc24e75d4496e891af4e2df51ed0d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.149255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.149745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.214501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8cc24e75d4496e891af4e2df51ed0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.223315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8cc24e75d4496e891af4e2df51ed0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.232046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8cc24e75d4496e891af4e2df51ed0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.233006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8cc24e75d4496e891af4e2df51ed0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.233649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8cc24e75d4496e891af4e2df51ed0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.235096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7670fa03d79547e7bb8222cb59866b08', 'request_id': 'req-69856ba5-a932-4783-adb4-9ece30d70141'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.241699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7670fa03d79547e7bb8222cb59866b08', 'request_id': 'req-69856ba5-a932-4783-adb4-9ece30d70141'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.250323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7670fa03d79547e7bb8222cb59866b08', 'request_id': 'req-69856ba5-a932-4783-adb4-9ece30d70141'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.259992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 923/1860] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:50 2022] DELETE /identity/v3/users/1b8cc24e75d4496e891af4e2df51ed0d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:50.260865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.262248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.268508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] The token cache is being invalidate because project 7670fa03d79547e7bb8222cb59866b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:50.268920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.270238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-69856ba5-a932-4783-adb4-9ece30d70141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.273030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 938/1861] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:49 2022] DELETE /identity/v3/projects/7670fa03d79547e7bb8222cb59866b08 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:50.274747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e07a-675a-46c1-9262-a58470f22fa9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.275091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e07a-675a-46c1-9262-a58470f22fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.275364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e07a-675a-46c1-9262-a58470f22fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.300566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e303e07a-675a-46c1-9262-a58470f22fa9 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.301851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e303e07a-675a-46c1-9262-a58470f22fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.330675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d3fa-5290-4d3a-92fd-cf0f4deebc80 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.334469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.335081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.335361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.335667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.337472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.350723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:50.372884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:50.383302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 939/1862] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.384574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79dbc-fe10-4cd9-99a7-9dd4162b4a4f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.384887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79dbc-fe10-4cd9-99a7-9dd4162b4a4f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.385154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79dbc-fe10-4cd9-99a7-9dd4162b4a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.404445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f8f79dbc-fe10-4cd9-99a7-9dd4162b4a4f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.406348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8f79dbc-fe10-4cd9-99a7-9dd4162b4a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.407251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.409392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.414777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 940/1863] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.416014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.416293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.416560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.422900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 924/1864] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:50.423804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.431606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.437212 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ebd4-c7fc-486f-878a-dd42d0d0a4b2 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.442066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.442889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.443168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.443333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.443434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] PATH_INFO: `/v3/projects/d41d38a326dd4049a72d408c67721e0c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.444560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41d38a326dd4049a72d408c67721e0c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.445156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.446969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.455707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 941/1865] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.456811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.458165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.478441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ddd38-a231-4f8c-bbfe-b491ab09a8ba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.488679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.489559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.489842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.490142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.504010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.505769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.522024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 942/1866] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:50.523155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.524501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.535226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41d38a326dd4049a72d408c67721e0c', 'request_id': 'req-4837603d-6dae-4818-b022-6c6ec309eafd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.542968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41d38a326dd4049a72d408c67721e0c', 'request_id': 'req-4837603d-6dae-4818-b022-6c6ec309eafd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.544845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb569-cc02-48de-adbc-6e5d0164ca57 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.552155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41d38a326dd4049a72d408c67721e0c', 'request_id': 'req-4837603d-6dae-4818-b022-6c6ec309eafd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.570109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] The token cache is being invalidate because project d41d38a326dd4049a72d408c67721e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:50.571196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.572103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4837603d-6dae-4818-b022-6c6ec309eafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:50.573937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 925/1867] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:50 2022] DELETE /identity/v3/projects/d41d38a326dd4049a72d408c67721e0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:50.576054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4870-437b-4a32-b176-7862e5bbff9d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.576664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4870-437b-4a32-b176-7862e5bbff9d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.581706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4870-437b-4a32-b176-7862e5bbff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.608149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a54b4870-437b-4a32-b176-7862e5bbff9d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.608619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.609267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.609420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a54b4870-437b-4a32-b176-7862e5bbff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.609674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.609951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.612218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.702504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.716058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 926/1868] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.717772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb073-ce64-429a-ac8f-3562ab584344 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.718699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb073-ce64-429a-ac8f-3562ab584344 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.718815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.719321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb073-ce64-429a-ac8f-3562ab584344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.731777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 943/1869] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:50.732671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.746625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fd8eb073-ce64-429a-ac8f-3562ab584344 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.747093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fe652-cd73-4864-9085-d2ad2878596d service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.748159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fd8eb073-ce64-429a-ac8f-3562ab584344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.753819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.754557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.754891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.755216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.756387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:50.756654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.758675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.760638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 927/1870] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:50.771681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.771983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.772229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.774996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 944/1871] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:50.780472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.801778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deed8-7ab7-449b-989d-f04ed71263b4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.806235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:50.808303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.808693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:50.808990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.809269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.809931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.810255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.812564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.825123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 928/1872] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:50.828474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.847901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f49a8-5321-476b-b28a-95d15e8bf645 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.854856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.855526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.855806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.856269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.857190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:50.857708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.861556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.864130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 945/1873] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:50.868279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.876455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 929/1874] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:50.883423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:50.896840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabc20-4679-476e-a29b-8b496202ecdf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.913461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:50.927899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:50.962799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cb55-fddb-4bff-b99d-596dedf06a6a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:50.968452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.969368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.969490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.971311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.971311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.972972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:50.973377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.974341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:50.974689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:50.975423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:50.976153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:50.978543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:50.999453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 946/1875] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:51.025750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.034490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 930/1876] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:50 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:51.035552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.041346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603644d8-3f7e-452a-bffe-4804639e6f32 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.134038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec882e-eff3-4dac-b54e-7f44436c2db4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.140248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.141291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.141414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.142441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.142629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.142888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.143433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.143931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.144496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.144607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.146309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.146973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.170984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 947/1877] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:51.175674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.197228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 931/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:51.197228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.197503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.217723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a63a-52f6-4c3b-8310-35841d14aa4f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.232322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898477fe-8a1b-4ef8-8956-0adfc2839a5a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.239276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.240139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.240139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.240341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] PATH_INFO: `/v3/projects/b443e0eff88d4029b1b3d33af4faffd5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.242580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b443e0eff88d4029b1b3d33af4faffd5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.243663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.245921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.245921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.245921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.245921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.246278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.247182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.261870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 948/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:51.262687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.276023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba761-df0b-4cac-9573-855cf775c3d9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.281500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.282258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.282543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.282817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.283465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.285146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.316378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 949/1880] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:51.316378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.337143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a757bd-819c-43c5-a603-a3dac8d30363 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.341648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b443e0eff88d4029b1b3d33af4faffd5', 'request_id': 'req-69334712-6a3d-435c-8c9e-e3642549e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.347546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b443e0eff88d4029b1b3d33af4faffd5', 'request_id': 'req-69334712-6a3d-435c-8c9e-e3642549e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.355738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b443e0eff88d4029b1b3d33af4faffd5', 'request_id': 'req-69334712-6a3d-435c-8c9e-e3642549e13a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.368598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] The token cache is being invalidate because project b443e0eff88d4029b1b3d33af4faffd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:51.369103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.370173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.372045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 932/1881] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:51 2022] DELETE /identity/v3/projects/b443e0eff88d4029b1b3d33af4faffd5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:51.375638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.377913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.396512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.397130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.397405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.397677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] PATH_INFO: `/v3/projects/8ce801e56ee4454e873029c83e83e59b/users/32723bb91e0d4ba3add7f17f4b0b3547/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.405257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.413444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce801e56ee4454e873029c83e83e59b, user_id=32723bb91e0d4ba3add7f17f4b0b3547, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.416184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.431654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 950/1882] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:51 2022] PUT /identity/v3/projects/8ce801e56ee4454e873029c83e83e59b/users/32723bb91e0d4ba3add7f17f4b0b3547/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:51.433501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.442559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.452746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.456802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334712-6a3d-435c-8c9e-e3642549e13a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.510066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f61c-717c-42f8-98b2-8235c58ec04c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.512949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.513582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.513858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.514126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] PATH_INFO: `/v3/projects/4352832f335c41129c80acdb52a3ced2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.514800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.515209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4352832f335c41129c80acdb52a3ced2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.515506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.515794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.516067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.517389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.518182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.518974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.528982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 951/1883] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:51.529780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.531409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.543558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec7b0-a8b2-4ec7-b95e-acbad9e94a8f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.550998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.551630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.551907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.552167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] PATH_INFO: `/v3/users/04ac53031fa143ac8adb392efa0b0405` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.553953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ac53031fa143ac8adb392efa0b0405)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.555903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.567413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4352832f335c41129c80acdb52a3ced2', 'request_id': 'req-35639317-3841-496c-a094-4995ccbb8d22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.574533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4352832f335c41129c80acdb52a3ced2', 'request_id': 'req-35639317-3841-496c-a094-4995ccbb8d22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.583357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4352832f335c41129c80acdb52a3ced2', 'request_id': 'req-35639317-3841-496c-a094-4995ccbb8d22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.598365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] The token cache is being invalidate because project 4352832f335c41129c80acdb52a3ced2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:51.598616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.601437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-35639317-3841-496c-a094-4995ccbb8d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.603980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 933/1884] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:51 2022] DELETE /identity/v3/projects/4352832f335c41129c80acdb52a3ced2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:51.605367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eb49-163f-4c61-9238-989c13bf424e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.605653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eb49-163f-4c61-9238-989c13bf424e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.605912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eb49-163f-4c61-9238-989c13bf424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.607851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ac53031fa143ac8adb392efa0b0405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.620498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ac53031fa143ac8adb392efa0b0405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.621318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ac53031fa143ac8adb392efa0b0405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.621992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ac53031fa143ac8adb392efa0b0405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.630888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ac53031fa143ac8adb392efa0b0405'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:51.637052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-97c5eb49-163f-4c61-9238-989c13bf424e None None] MFA Rules not processed for user `32723bb91e0d4ba3add7f17f4b0b3547`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:51.638291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97c5eb49-163f-4c61-9238-989c13bf424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.654598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 952/1885] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:51 2022] DELETE /identity/v3/users/04ac53031fa143ac8adb392efa0b0405 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:51.654598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.656286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.702878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.737362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 934/1886] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:51.738082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.738379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.739174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.754269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a410-b2b3-404c-95e6-6658a297cfb4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.760828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.761590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.761874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.762200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] PATH_INFO: `/v3/projects/6ed61093f6f54cae91029808a974de0e/users/b6cf5dc9b554431d90bc0a7a1d12fe9b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.764448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:51.766367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.787847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 935/1887] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:51.788544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed61093f6f54cae91029808a974de0e, user_id=b6cf5dc9b554431d90bc0a7a1d12fe9b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.788758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.791535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.792239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582a18-5fbc-418e-9cdf-01d165178f6f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.809276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.818374 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 953/1888] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:51 2022] PUT /identity/v3/projects/6ed61093f6f54cae91029808a974de0e/users/b6cf5dc9b554431d90bc0a7a1d12fe9b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:51.819552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3a33-d337-4674-998c-d15d2961c229 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.819870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eda63-f7c0-4573-8279-e91a90b8e53c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.820325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eda63-f7c0-4573-8279-e91a90b8e53c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.822305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eda63-f7c0-4573-8279-e91a90b8e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.847333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a02eda63-f7c0-4573-8279-e91a90b8e53c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:51.848608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a02eda63-f7c0-4573-8279-e91a90b8e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.914318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.914873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.915153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.915426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.916065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.918310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.978685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 954/1889] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:51.981245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 936/1890] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:51.981635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.985897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.985897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.989241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.023316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] MFA Rules not processed for user `b6cf5dc9b554431d90bc0a7a1d12fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:52.025227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.112294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abca4e-9dd5-4c5e-be99-236f06835026 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.121696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.122534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.122815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.123082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.124132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:52.124510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.127633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.148043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 937/1891] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:52.149355 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.160073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0a12-bee4-4ba7-821a-b2b5c3313a03 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.167570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.168964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.170109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.171039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.171681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.172339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 955/1892] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:52.173992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.175177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.177388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.192886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7440-ea88-4dc2-9926-2ca9cbf418f8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.197939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.198610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.199018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.199142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] PATH_INFO: `/v3/projects/be073504dfc340189dc87b7577a63cff` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.200680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=be073504dfc340189dc87b7577a63cff)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.201854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 938/1893] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/users => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.202209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.203177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.215133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1651-6303-4208-bc17-929bf19d94d5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.222226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.222830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.223111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.223382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.224058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.226093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.257776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 939/1894] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.257776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.258066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be073504dfc340189dc87b7577a63cff', 'request_id': 'req-b54fd314-c03e-46da-9e4d-0f760d731ddd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:52.263637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be073504dfc340189dc87b7577a63cff', 'request_id': 'req-b54fd314-c03e-46da-9e4d-0f760d731ddd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:52.272022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be073504dfc340189dc87b7577a63cff', 'request_id': 'req-b54fd314-c03e-46da-9e4d-0f760d731ddd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:52.283828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] The token cache is being invalidate because project be073504dfc340189dc87b7577a63cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:52.284102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:52.284796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:52.284997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:52.286342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 956/1895] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:52 2022] DELETE /identity/v3/projects/be073504dfc340189dc87b7577a63cff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:52.287115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.288430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.304681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:52.325778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ecb2b-15d6-4b38-9f91-8b8cf520de28 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.330950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.331584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.331865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.332134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.332817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.334759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.365713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd314-c03e-46da-9e4d-0f760d731ddd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.374216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.375009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.375267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.375684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.377372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.378938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 940/1896] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.379939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4a2e-01f1-4054-8f05-a485f822e8d0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.380184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.382185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.391409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 957/1897] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:52.393655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.393943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.394217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.416969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:52.420377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.464563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d360-2558-438e-8678-7153ce85b722 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.470747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.471688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.472804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.473347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.474370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.476826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.484004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 958/1898] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:52.491667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.493460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.507423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527a3c-5d3a-4652-89f1-06c47db19a05 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.512324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.512973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.513256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.513587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.514221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.516185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768fb04-2e26-484b-88c3-250c83329bea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.524470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 941/1899] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.525625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.543092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 959/1900] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.544618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.545023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.545380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.546227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097082-5be8-46b2-b7b8-06697009cece admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.552386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.553582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.554632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.554745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] PATH_INFO: `/v3/projects/e49e3d3e830549dab6b2471e793bea8d/users/0115b1d8675b48fe956472022bf1206a/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.568436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:52.569880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:52.574363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49e3d3e830549dab6b2471e793bea8d, user_id=0115b1d8675b48fe956472022bf1206a, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.577642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.584798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 960/1901] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:52.586194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.598360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d929-edc3-4ff8-b14b-76b57081488b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.604874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 942/1902] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:52 2022] PUT /identity/v3/projects/e49e3d3e830549dab6b2471e793bea8d/users/0115b1d8675b48fe956472022bf1206a/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:52.607002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.698990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.699605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.699887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.700429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.700837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.702431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.713949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 961/1903] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:52.714722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.714912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae9289-6dc5-4d90-873a-a6d48d59dd12 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.720718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.721334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.721614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.721887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.722530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.724134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.726381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ee72-72b6-4aa5-bd72-948ca9b68b25 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.731206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.731858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.732140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.732415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.733090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:52.733393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.738361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 943/1904] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:52.738501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.738611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.745932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874de5-8d41-4933-bb3c-2d8ed39f40ff admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.749737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 962/1905] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:52.750547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.750914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.752232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.752508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.752813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.753449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.755171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.760611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:52.761370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4353-dbba-4318-a2a4-bf19ae55a2a8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.765852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 944/1906] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:52.766404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.767087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.767370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.767578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.767688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.768271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.770214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.772401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:52.778887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc4f9-15bd-4546-a004-aa782cb2b191 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.781636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 963/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:52.782627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.784186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.785091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.785216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.785411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] PATH_INFO: `/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc/users/25c304b6e78845a4862e465c21a6f3e1/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.793038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17eb24-203f-4185-93fb-1bf992d5c289 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.797717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.798976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.799263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.799536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.800187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.801192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d4d59289644d9b7d57bd8ec8ccfcc, user_id=25c304b6e78845a4862e465c21a6f3e1, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.802112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.803828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.817402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 945/1908] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:52 2022] PUT /identity/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc/users/25c304b6e78845a4862e465c21a6f3e1/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:52.818179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.832639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 964/1909] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:52.833755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.883590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c4e4-8017-4fd4-a712-b5ce6ed6fc99 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.898056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214305e-4cc4-4b04-86c0-015a036dcc32 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:52.902649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.903303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.903584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.903855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] PATH_INFO: `/v3/projects/81cd9913eb9843a5838861833b8b74bb/users/f4b818859d2843e79f129fe40b605d56/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.921801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd9913eb9843a5838861833b8b74bb, user_id=f4b818859d2843e79f129fe40b605d56, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.925191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.938078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 965/1910] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:52 2022] PUT /identity/v3/projects/81cd9913eb9843a5838861833b8b74bb/users/f4b818859d2843e79f129fe40b605d56/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:52.939555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:52.942046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:52.942734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:52.942995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:52.943267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] PATH_INFO: `/v3/projects/e49e3d3e830549dab6b2471e793bea8d/users/0115b1d8675b48fe956472022bf1206a/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:52.945216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49e3d3e830549dab6b2471e793bea8d, user_id=0115b1d8675b48fe956472022bf1206a, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:52.948039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:52.960317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 946/1911] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:52 2022] PUT /identity/v3/projects/e49e3d3e830549dab6b2471e793bea8d/users/0115b1d8675b48fe956472022bf1206a/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:52.961496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.007245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839a80-c556-4b17-b8fd-41a15d458bad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.029982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119543d-32ed-4b48-8c80-e4bd3a9b4c7c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.035487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.036084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.036359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.036628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.037268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.039179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522b937-b2bb-4b8a-ab73-a7a16d53c0b6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.061974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 947/1912] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:52 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:53.063547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.064302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.064557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.065616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.066223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.066526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.066792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.067470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.069308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0c25d-8898-4dfd-bd5c-f154d1eb0687 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.079691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:53.084551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 966/1913] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:53.084551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.084551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.084551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.091133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:53.100318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] MFA Rules not processed for user `f4b818859d2843e79f129fe40b605d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:53.101871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.121527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] MFA Rules not processed for user `0115b1d8675b48fe956472022bf1206a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:53.122740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.177006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 948/1914] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:53.178335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.191863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28a9d2-04fb-44fa-be4c-90270ba8c8e5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.196743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.197369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.197649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.198493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.198618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.200165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.210906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 949/1916] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:53.211078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 967/1916] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:53.211714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.212297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.226013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921381a-414e-497c-8609-86e53bd44026 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.232821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.233599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.233976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.234100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6657-23e8-4e4c-b703-4b56294b508a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.234430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] PATH_INFO: `/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc/users/25c304b6e78845a4862e465c21a6f3e1/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.237225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d4d59289644d9b7d57bd8ec8ccfcc, user_id=25c304b6e78845a4862e465c21a6f3e1, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.240407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.241463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.242462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.242878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.243409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.244182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.246835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.254180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 950/1917] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:53 2022] PUT /identity/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc/users/25c304b6e78845a4862e465c21a6f3e1/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:53.254998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.279165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 968/1918] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:53.280273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.283205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.335183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf25c-22bf-46aa-a111-d2f3ee66e2b4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.347878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbbb43-593e-4c01-afc5-396ee614e1f0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.351957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.352564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.352871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.353140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.397476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.398230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.398513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.398784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.399425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.401076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0ea9e-eb63-4cea-864a-fae9af1f6a97 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.413088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 951/1919] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:53.417859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.417859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.417859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.432984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.434421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.444715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] MFA Rules not processed for user `25c304b6e78845a4862e465c21a6f3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:53.445926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.446081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 969/1920] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:53.446799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.450287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:53.459110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212425-3282-4106-b876-1b9c1a03c776 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.466812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.467480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.467740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.468013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.469002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.471825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.490339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:53.498783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 970/1921] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:53.500043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.510241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920f108-3299-4afa-805a-bdb973d459cd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.514974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.515632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.515915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.516189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] PATH_INFO: `/v3/projects/bc5492cf8b714b06a41fda3bcaf404f8/users/ce696fd1e1b64dd1bb250ae774863e1b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.530121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 952/1922] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:53.531168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.544588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224822-bdf3-42f1-a989-a862a5d48483 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.549716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5492cf8b714b06a41fda3bcaf404f8, user_id=ce696fd1e1b64dd1bb250ae774863e1b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.550215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.551023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.551310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.552346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.552691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.552795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.554636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.572971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 953/1923] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:53.572971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.573831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 971/1924] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:53 2022] PUT /identity/v3/projects/bc5492cf8b714b06a41fda3bcaf404f8/users/ce696fd1e1b64dd1bb250ae774863e1b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:53.574508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.577383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.591512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fdef-48bd-41a1-9459-7523f039629b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.648971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.649616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.649933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.650251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.660845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc979-5e0b-4a23-aa5e-9b02a2679ac7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.669731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.670948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.671296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.671637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.674736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.676741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.690623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 972/1925] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:53.694569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.707190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29dfc-ff43-478d-9acc-05bdaa6126f1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.711027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.711635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.711911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.712180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.714132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.777806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.779358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316324a-5cf1-4d1f-83b1-0a2bbbfbc410 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.792060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 954/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:53.793532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.794007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.794350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.808689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.810827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.832371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] MFA Rules not processed for user `ce696fd1e1b64dd1bb250ae774863e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:53.833755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.836278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 973/1927] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:53.841689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:53.857278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3068c-6def-4ad0-a61f-ff2193f63c9b service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:53.871731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:53.872698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.873079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.873493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] PATH_INFO: `/v3/projects/952162c7dda44bffa7cf7b3c77d9e625/users/264ac4e95cf541fe9b9cae6e3efb05f1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.891036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952162c7dda44bffa7cf7b3c77d9e625, user_id=264ac4e95cf541fe9b9cae6e3efb05f1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:53.894372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1a00e-1575-49bd-9872-a0b099c95362 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:53.901307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:53.916819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 974/1928] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:53 2022] PUT /identity/v3/projects/952162c7dda44bffa7cf7b3c77d9e625/users/264ac4e95cf541fe9b9cae6e3efb05f1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:53.931385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:53.931672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:53.933012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:53.994149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 955/1929] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:53.995739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] MFA Rules not processed for user `264ac4e95cf541fe9b9cae6e3efb05f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:53.997357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:53.998105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.016173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99bc8b-ea4a-48ae-bfbd-3edf0b9c1e95 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.055106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:54.102551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.103363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.103732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.104007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.104752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.106915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.157926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 975/1930] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:54.161517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.172171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 956/1931] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:53 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:54.176448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.183946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08f33-cfec-4b6d-9263-023390b22b7b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.285314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.286288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.286825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.287927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.288656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.291012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.318281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc5bb8-d69a-48fa-a9a8-32320d2c8a72 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.324800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.325528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.325963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.326352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.327090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.330415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.332891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 976/1932] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:54 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:54.336839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.364701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 957/1933] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:54 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:54.365889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.382617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208776-c641-45be-b1c3-8c29003cd13e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.477380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:54.500735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1beee-f66a-4136-a9b0-09c0130f237a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.511434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.511993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.512226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.512352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.512518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.513060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.513184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.513339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.513753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.514474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.515171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.517687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.533427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 958/1934] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:54.534444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.547460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 977/1935] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:54 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:54.548537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a12f-bea9-4ade-aaf3-ea3064900189 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.551100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.563034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.564234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.564424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.564839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] PATH_INFO: `/v3/projects/eef781a2c35a43359fd52ab6f50adee8/users/0d702b47e0c648c899fee01551ce5ac2/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.567172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad55b0-3cab-4c0f-865b-ec19de75ff97 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.573600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.575167 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.575659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.576154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.577115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.580216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.584194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef781a2c35a43359fd52ab6f50adee8, user_id=0d702b47e0c648c899fee01551ce5ac2, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.588130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.593692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 978/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:54.598593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.613673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 959/1937] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:54 2022] PUT /identity/v3/projects/eef781a2c35a43359fd52ab6f50adee8/users/0d702b47e0c648c899fee01551ce5ac2/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:54.616146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830763a8-85bc-4d32-9dfa-144b0710263f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.619847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.665117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:54.704905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8740-12fa-45e1-bb02-af4dd36d262d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.710095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.710540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.710822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.711095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.711891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.713326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.713621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.714156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.714434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.714703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] PATH_INFO: `/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e/users/95e54dacfb5f4d2cb852a37c5d1fef91/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.733528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 960/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:54.734599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.736693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea13229ea0704cdd9cc43cfb701aac4e, user_id=95e54dacfb5f4d2cb852a37c5d1fef91, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.740969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.747499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb07bd-5050-40d9-9504-fe77369cb48b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.757421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.760562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.760879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.761160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] PATH_INFO: `/v3/projects/eef781a2c35a43359fd52ab6f50adee8/users/0d702b47e0c648c899fee01551ce5ac2/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.763428 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef781a2c35a43359fd52ab6f50adee8, user_id=0d702b47e0c648c899fee01551ce5ac2, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.763950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 979/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:54 2022] PUT /identity/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e/users/95e54dacfb5f4d2cb852a37c5d1fef91/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:54.766308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973e1e-4cb1-4375-929e-fad420592186 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.768368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.788676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 961/1940] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:54 2022] PUT /identity/v3/projects/eef781a2c35a43359fd52ab6f50adee8/users/0d702b47e0c648c899fee01551ce5ac2/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:54.792245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.792557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.792890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.824118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] MFA Rules not processed for user `0d702b47e0c648c899fee01551ce5ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:54.825385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:54.850831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3c5f-db2b-4c79-abe3-952fb51fd745 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.910287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 962/1941] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:54.916064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.916709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.916989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.917259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.917907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.919485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.922509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.931410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 980/1942] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:22:54.936480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:54.946440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15aed0-e49d-42e4-b734-c725c7a0aa73 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:54.951279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:54.951653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.951833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:54.951954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.952179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] PATH_INFO: `/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e/users/95e54dacfb5f4d2cb852a37c5d1fef91/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.954850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea13229ea0704cdd9cc43cfb701aac4e, user_id=95e54dacfb5f4d2cb852a37c5d1fef91, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:54.957622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5938fcd-ab4b-4709-9c46-30f790fe0ecd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:54.971275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 981/1943] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:54 2022] PUT /identity/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e/users/95e54dacfb5f4d2cb852a37c5d1fef91/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:54.984688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:54.984983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:54.985284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:54.994561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd602-ae9c-4997-aa23-613d00da559c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:55.081341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] MFA Rules not processed for user `95e54dacfb5f4d2cb852a37c5d1fef91`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:55.084108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:55.084905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:55.085235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:55.085627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:55.086128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:55.168877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:55.197320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:55.199180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:55.220831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 963/1944] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:22:55.227037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 982/1945] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:55.249170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:55.258761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb441-8b97-4656-bc55-8e869fe36299 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:55.263873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:55.264519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:55.264832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:55.265137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:55.327326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:55.328802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee83d-2801-4088-9aca-9ba089d9ffe4 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:55.337934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 964/1946] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:56.194666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:56.260045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285f00-60d6-49f1-9599-268eb369b37e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:56.264550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:56.265205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:56.265486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:56.265757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] PATH_INFO: `/v3/users/b6cf5dc9b554431d90bc0a7a1d12fe9b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:56.266947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6cf5dc9b554431d90bc0a7a1d12fe9b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:56.268934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:56.331936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6cf5dc9b554431d90bc0a7a1d12fe9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:56.341266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6cf5dc9b554431d90bc0a7a1d12fe9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:56.342118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6cf5dc9b554431d90bc0a7a1d12fe9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:56.342795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6cf5dc9b554431d90bc0a7a1d12fe9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:56.353699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6cf5dc9b554431d90bc0a7a1d12fe9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:56.373051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 983/1947] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:56 2022] DELETE /identity/v3/users/b6cf5dc9b554431d90bc0a7a1d12fe9b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:56.378444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:56.379053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:56.379053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:56.398914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:56.400140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:56.449284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:56.484522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 965/1948] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:56.494436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:56.495978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:56.585105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14720-cc50-4296-859e-17ca211c3d96 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:56.588787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:56.590010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:56.590296 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:56.590563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:56.602572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:56.604030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:56.609650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:56.621554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 984/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:56.695991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:56.698233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:56.791779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840417-35a8-4261-9ba6-d6080efd9757 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:56.796053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:56.798793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:56.798793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:56.798793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:56.800899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:56.929866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:56.931393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:56.945423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 966/1950] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:56.993948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:56.999973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:57.045200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5244b4-dfc2-4184-a856-4924e4e1f7df service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:57.066155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:57.066940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:57.069237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:57.070372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] PATH_INFO: `/v3/users/32723bb91e0d4ba3add7f17f4b0b3547` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:57.071415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:57.072666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:57.079791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32723bb91e0d4ba3add7f17f4b0b3547)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:57.082275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:57.086108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bfbe5-17c1-4d4e-996c-94c2d2d926b1 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:57.090699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:57.091360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:57.091746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:57.091949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:57.095440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:57.185899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32723bb91e0d4ba3add7f17f4b0b3547'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:57.206366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32723bb91e0d4ba3add7f17f4b0b3547'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:57.208691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32723bb91e0d4ba3add7f17f4b0b3547'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:57.212467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32723bb91e0d4ba3add7f17f4b0b3547'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:57.222768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3cff07d1-1b4c-42af-a642-fb308124aa26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32723bb91e0d4ba3add7f17f4b0b3547'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:57.230457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:57.232026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:57.252703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 985/1951] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:56 2022] DELETE /identity/v3/users/32723bb91e0d4ba3add7f17f4b0b3547 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:57.257207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 967/1952] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:22:57.261931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:57.262224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:57.262504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:57.293846 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:57.295415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:57.381811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 986/1953] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:57.393099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:57.394729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:57.418263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f54-a261-4477-b7df-0a32e95e49ae service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:57.450290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:57.494402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:57.495030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:57.495308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:57.495579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:57.511752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:57.513397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:57.532860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 968/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:58.057870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:58.060010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.079415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:58.082227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.114588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f9ed4-5156-48a4-bfe3-d287e7ece552 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:58.123859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:58.124838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:58.125126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:58.125400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] PATH_INFO: `/v3/projects/6ed61093f6f54cae91029808a974de0e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:58.127131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed61093f6f54cae91029808a974de0e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:58.131106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:58.192871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b569f44-68e7-4d4b-9d0f-ee986180e2ec None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:58.222647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed61093f6f54cae91029808a974de0e', 'request_id': 'req-8b311a4d-63f3-4dde-aba9-d865360ea332'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.227467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:58.232222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed61093f6f54cae91029808a974de0e', 'request_id': 'req-8b311a4d-63f3-4dde-aba9-d865360ea332'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.249062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed61093f6f54cae91029808a974de0e', 'request_id': 'req-8b311a4d-63f3-4dde-aba9-d865360ea332'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.267882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] The token cache is being invalidate because project 6ed61093f6f54cae91029808a974de0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:58.268547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.273603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.275864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 969/1955] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:58 2022] DELETE /identity/v3/projects/6ed61093f6f54cae91029808a974de0e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:58.276892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:58.279361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.294949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:58.296260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:58.296260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:58.296260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:58.298051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.362187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a4d-63f3-4dde-aba9-d865360ea332 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:58.367460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:58.368189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:58.368473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:58.368778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] PATH_INFO: `/v3/projects/8ce801e56ee4454e873029c83e83e59b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:58.369886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce801e56ee4454e873029c83e83e59b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:58.371866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:58.377193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:58.378635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:58.389546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 987/1956] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:22:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:22:58.390379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:58.396985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.420816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfb8b4-5d6f-401d-a76a-ccf3be91a100 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:58.426552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce801e56ee4454e873029c83e83e59b', 'request_id': 'req-26494b96-a621-45a9-820d-d309af0e207d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.430891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:58.436625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce801e56ee4454e873029c83e83e59b', 'request_id': 'req-26494b96-a621-45a9-820d-d309af0e207d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.451397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce801e56ee4454e873029c83e83e59b', 'request_id': 'req-26494b96-a621-45a9-820d-d309af0e207d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.470651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] The token cache is being invalidate because project 8ce801e56ee4454e873029c83e83e59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:58.471042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.472450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.474279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 970/1957] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:58 2022] DELETE /identity/v3/projects/8ce801e56ee4454e873029c83e83e59b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:58.479052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:58.481157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:58.504414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:58.506253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:58.506705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:58.508154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] PATH_INFO: `/v3/users/25c304b6e78845a4862e465c21a6f3e1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:58.510542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c304b6e78845a4862e465c21a6f3e1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:58.514850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:58.560930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26494b96-a621-45a9-820d-d309af0e207d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:58.566502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:58.567217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:58.567547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:58.574875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c304b6e78845a4862e465c21a6f3e1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.576526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] PATH_INFO: `/v3/users/0115b1d8675b48fe956472022bf1206a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:58.578310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0115b1d8675b48fe956472022bf1206a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:58.581023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:58.587800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c304b6e78845a4862e465c21a6f3e1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.589020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c304b6e78845a4862e465c21a6f3e1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.590965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c304b6e78845a4862e465c21a6f3e1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.604458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c304b6e78845a4862e465c21a6f3e1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.637219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:58.650936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 988/1958] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:58 2022] DELETE /identity/v3/users/25c304b6e78845a4862e465c21a6f3e1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:58.708893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0115b1d8675b48fe956472022bf1206a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.728500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0115b1d8675b48fe956472022bf1206a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.746506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0115b1d8675b48fe956472022bf1206a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.747702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0115b1d8675b48fe956472022bf1206a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.749897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b0cdb535-0ee8-4784-9130-9cdc314ba821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0115b1d8675b48fe956472022bf1206a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:58.821733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 971/1959] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:22:58 2022] DELETE /identity/v3/users/0115b1d8675b48fe956472022bf1206a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:59.163643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.166070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.254461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fa38-6017-4f95-9404-eaaed5221046 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.319869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.320517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.320839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.321117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] PATH_INFO: `/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.322305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=608d4d59289644d9b7d57bd8ec8ccfcc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.324208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.375281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608d4d59289644d9b7d57bd8ec8ccfcc', 'request_id': 'req-1af58183-a757-4d5b-a9f7-8751f287df9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.384863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608d4d59289644d9b7d57bd8ec8ccfcc', 'request_id': 'req-1af58183-a757-4d5b-a9f7-8751f287df9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.394120 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608d4d59289644d9b7d57bd8ec8ccfcc', 'request_id': 'req-1af58183-a757-4d5b-a9f7-8751f287df9b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.408738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] The token cache is being invalidate because project 608d4d59289644d9b7d57bd8ec8ccfcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:59.409164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.410097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.412019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 989/1960] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:59 2022] DELETE /identity/v3/projects/608d4d59289644d9b7d57bd8ec8ccfcc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:59.416895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f54f-fd44-4186-bdc7-d3c978bbe4ce None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.417580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f54f-fd44-4186-bdc7-d3c978bbe4ce None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.418037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f54f-fd44-4186-bdc7-d3c978bbe4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.452635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-82a6f54f-fd44-4186-bdc7-d3c978bbe4ce None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:59.454349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-82a6f54f-fd44-4186-bdc7-d3c978bbe4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.524236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:59.539760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 972/1961] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:59.547671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.549463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.549786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.550300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.550932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.572059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58183-a757-4d5b-a9f7-8751f287df9b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.575560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:59.577133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.581855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.582809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.583192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.583626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] PATH_INFO: `/v3/projects/e49e3d3e830549dab6b2471e793bea8d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.585141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49e3d3e830549dab6b2471e793bea8d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.588687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.592016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 973/1962] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:22:59.597693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.610383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc69c-2ec7-4898-9a4e-b40612ba62b4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.618200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.619109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.619246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.619426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.620240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:59.620633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.622706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.629883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:59.639695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 974/1963] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:59.644837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.652098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49e3d3e830549dab6b2471e793bea8d', 'request_id': 'req-742a605a-0572-4ff4-8009-7bd2994083b0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.654916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272d63-f4b8-4e26-9489-315c7005350f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.661302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49e3d3e830549dab6b2471e793bea8d', 'request_id': 'req-742a605a-0572-4ff4-8009-7bd2994083b0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.671386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49e3d3e830549dab6b2471e793bea8d', 'request_id': 'req-742a605a-0572-4ff4-8009-7bd2994083b0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.687813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] The token cache is being invalidate because project e49e3d3e830549dab6b2471e793bea8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:22:59.688949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.689817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-742a605a-0572-4ff4-8009-7bd2994083b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:22:59.691430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 990/1964] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:22:59 2022] DELETE /identity/v3/projects/e49e3d3e830549dab6b2471e793bea8d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:59.696406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba42778-731e-407b-a1d4-0bf55ca99bf6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.696848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba42778-731e-407b-a1d4-0bf55ca99bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.697228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba42778-731e-407b-a1d4-0bf55ca99bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.721142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3ba42778-731e-407b-a1d4-0bf55ca99bf6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:59.722469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3ba42778-731e-407b-a1d4-0bf55ca99bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.725825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.726708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.726993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.727266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.727887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.730071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.731834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 991/1965] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:59.740285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.740572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.740881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.761011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 975/1966] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:22:59.761458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:59.762663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.764853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.766654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:59.843644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6875-a7c2-48a2-863d-8f753c996cf4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.849554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.850239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.850857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.851201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.852161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.854268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.858548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 992/1967] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:22:59.859665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.872816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e4e0c-2ebc-4074-8592-d5d3c2fb81a1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.879809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.880474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.880782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.881050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.881700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:59.881998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.896061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.896179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 976/1968] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:59.896179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.898580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 993/1969] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:59.904095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.908211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556e126-88bc-4145-9c71-a49f5e4a99d8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.912595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.913312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.913703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.914046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.914782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.914935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ed2d-1efa-48a7-a6cc-5a1097be37e5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.916774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.920512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.921201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.921582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.921914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.923510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.925911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.928750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 977/1970] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:59.932809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.944544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512efc-c5c4-4ed6-97bd-58b5141ee9da admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:59.949679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:59.950327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:59.950627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:59.950905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:59.951536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:59.953179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:59.961094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 994/1971] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:59.967946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 978/1972] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:22:59.968093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.974872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:59.992970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577da02d-1940-476f-9ec6-118abf809a4f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.050118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:00.078569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21135f-5854-4a55-ae45-a5f4610a7fcb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.084984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.086168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.086688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.086969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.087804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.090703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.128084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 995/1973] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:59 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:00.130322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.143150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:00.146261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.146984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.147257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.147600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] PATH_INFO: `/v3/projects/d825281518d14a9097ae4def21523071/users/130a3cfcc32145798ee3f8ec0cc38128/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.147900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6625-bb58-40b8-9f28-ecc41066c4ae admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.154875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.155966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.158147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.159799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.161942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.164333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.181345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 996/1974] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:00.187072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.188431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d825281518d14a9097ae4def21523071, user_id=130a3cfcc32145798ee3f8ec0cc38128, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.192351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74353f-1cae-4466-985b-9de47121485c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.207207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1c30-ce93-4256-a217-ddcb5e47daad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.216425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 979/1975] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:22:59 2022] PUT /identity/v3/projects/d825281518d14a9097ae4def21523071/users/130a3cfcc32145798ee3f8ec0cc38128/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:00.227848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.228214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.228546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.286815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] MFA Rules not processed for user `130a3cfcc32145798ee3f8ec0cc38128`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:00.290470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:00.330849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.331499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.331759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.332025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.335538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.337889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.354547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 997/1976] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:00.358548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.373679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02b51-20cd-43b2-bee9-9f1f1886ed80 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.379939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.380962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.381569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.382108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] PATH_INFO: `/v3/projects/45a45368ca844789af71be7ebfa8f86b/users/439c49c0d87a4764b0c7c71d40c23071/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.400595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 980/1977] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:00.402360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a45368ca844789af71be7ebfa8f86b, user_id=439c49c0d87a4764b0c7c71d40c23071, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.405013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.405541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0bc65-4170-48cc-a235-348add696014 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.427018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eec31b-0468-42aa-9a1b-eba3f8bbbb15 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.428594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 998/1978] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:00 2022] PUT /identity/v3/projects/45a45368ca844789af71be7ebfa8f86b/users/439c49c0d87a4764b0c7c71d40c23071/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:00.437987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.439700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.439700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.461980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:00.464618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:00.513368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.514989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.515744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.516226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.517190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.520779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.559621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 981/1979] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:00 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:00.561202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 999/1980] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:00.564272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.576868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.578575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:00.637290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:00.658617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1094bb-55d0-449e-99c4-b1f686932b5e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.681791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:00.682925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133b00-922e-43cc-af92-39dc624298a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.688592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.689989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.690996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.691336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.692128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.694730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.721943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.722961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.723302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.723431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 982/1981] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:00 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:00.723694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.728638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.737606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.739165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.749755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1000/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:00.765405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4d32-cc4e-4817-8df1-75005f0a40d4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.790347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.792687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.792687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.792687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.800354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.802211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.822226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 983/1983] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:00.826619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.841190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1c949-ae9b-45a0-ae52-9f96d58247d4 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:00.852955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:00.854119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:00.854416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:00.854683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] PATH_INFO: `/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c/users/c0d047de2f594210966c6df454c329d4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:00.912530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a9d64ffe464bc4b342dbdbc858649c, user_id=c0d047de2f594210966c6df454c329d4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:00.920263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:00.938611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1001/1984] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:00 2022] PUT /identity/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c/users/c0d047de2f594210966c6df454c329d4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:00.942691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:00.963726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186534c1-7181-4774-a8a9-d86b2bcb205a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.085639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.086315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.089238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.090027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.090917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.093333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf36f-a411-45e3-b588-8e71609e6e8f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.104618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 984/1985] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:01.108896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.120505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8acc-0dbc-4935-8573-ff18dccabe4a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.127168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.128088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.128531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.128843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] PATH_INFO: `/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c/users/c0d047de2f594210966c6df454c329d4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.131059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a9d64ffe464bc4b342dbdbc858649c, user_id=c0d047de2f594210966c6df454c329d4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.134507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.146063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1002/1986] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:01 2022] PUT /identity/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c/users/c0d047de2f594210966c6df454c329d4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:01.158586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.159274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.159735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.193950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] MFA Rules not processed for user `c0d047de2f594210966c6df454c329d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:01.195758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.284527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 985/1987] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:01.295398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.297336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.399879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066cd3-1667-4174-b69e-373861ac4998 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.408052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.408904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.409260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.409627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.431159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.432765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.434112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.435539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.452001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1003/1988] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:01.504358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:01.559730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59a7f0-c84c-42a0-9775-2cc4ed039042 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.567359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.568275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.568755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.569391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] PATH_INFO: `/v3/users/ce696fd1e1b64dd1bb250ae774863e1b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.571438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce696fd1e1b64dd1bb250ae774863e1b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.574367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.644238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.650288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce696fd1e1b64dd1bb250ae774863e1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.657907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863d54-46ec-4547-a4de-30353a26dd78 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.659867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce696fd1e1b64dd1bb250ae774863e1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.663537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.664335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.664929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.665129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] PATH_INFO: `/v3/users/130a3cfcc32145798ee3f8ec0cc38128` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.666493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130a3cfcc32145798ee3f8ec0cc38128)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.668858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.671973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce696fd1e1b64dd1bb250ae774863e1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.673399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce696fd1e1b64dd1bb250ae774863e1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.674068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a77b3fe7-07c7-468a-867a-029ac9d4c463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce696fd1e1b64dd1bb250ae774863e1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.699004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 986/1989] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:01 2022] DELETE /identity/v3/users/ce696fd1e1b64dd1bb250ae774863e1b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:01.701897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.702219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.702517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.740394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:01.742013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.746912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130a3cfcc32145798ee3f8ec0cc38128'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.762183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130a3cfcc32145798ee3f8ec0cc38128'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.763589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130a3cfcc32145798ee3f8ec0cc38128'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.764549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130a3cfcc32145798ee3f8ec0cc38128'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.778595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7473d9f3-bf23-4c18-95b8-57d366a6e802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130a3cfcc32145798ee3f8ec0cc38128'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:01.814468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1004/1990] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:01 2022] DELETE /identity/v3/users/130a3cfcc32145798ee3f8ec0cc38128 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:01.815864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.816155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.816428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.829726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:01.831165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 987/1991] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:01.842174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.844101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.845998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:01.847156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:01.908556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:01.914039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c193d4a-e0e7-4d36-ab09-8891c54d7a4c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:01.924252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1005/1992] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:01.935209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:01.972334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:01.973079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:01.973412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:01.973753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:01.984191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:01.986436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509c19-f4e9-4395-b50a-8b223135dcf8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:01.998408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 988/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:02.008064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6a8e-4011-43ca-a1a8-65d04f10137b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:02.013170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:02.014036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.014408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.015185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.026869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:02.028711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:02.040689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1006/1994] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:02.216597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.217118 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.217485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.266793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] MFA Rules not processed for user `439c49c0d87a4764b0c7c71d40c23071`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:02.268939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.402267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 989/1995] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:02.418701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:02.420771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.505494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:02.507505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.523659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1ddf8-68cc-4179-9aa0-26c4ca155359 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:02.524398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fb119-eafb-4c51-82d3-76e3200eb315 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:02.528165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:02.529054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.529165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:02.529837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.530097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.530540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.530647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.530885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] PATH_INFO: `/v3/users/f4b818859d2843e79f129fe40b605d56` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.533105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b818859d2843e79f129fe40b605d56)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:02.535598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:02.543213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:02.544980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:02.557695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1007/1996] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:02.648034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b818859d2843e79f129fe40b605d56'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.649230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:02.650906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.665333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b818859d2843e79f129fe40b605d56'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.683822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3a45-54a3-435d-a740-7c33db245a1a service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:02.689693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b818859d2843e79f129fe40b605d56'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.691452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b818859d2843e79f129fe40b605d56'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.693465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b818859d2843e79f129fe40b605d56'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.698616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:02.699884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.701640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.702009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] PATH_INFO: `/v3/projects/bc5492cf8b714b06a41fda3bcaf404f8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.708273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5492cf8b714b06a41fda3bcaf404f8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:02.710653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:02.752342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 990/1997] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:02 2022] DELETE /identity/v3/users/f4b818859d2843e79f129fe40b605d56 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:02.754508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:02.757205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.783239 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:02.828753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:02.836429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5492cf8b714b06a41fda3bcaf404f8', 'request_id': 'req-9df67cd1-9562-43f7-94c8-038efa832132'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.843813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5492cf8b714b06a41fda3bcaf404f8', 'request_id': 'req-9df67cd1-9562-43f7-94c8-038efa832132'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.869292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5492cf8b714b06a41fda3bcaf404f8', 'request_id': 'req-9df67cd1-9562-43f7-94c8-038efa832132'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.896004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] The token cache is being invalidate because project bc5492cf8b714b06a41fda3bcaf404f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:02.896375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.897091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9df67cd1-9562-43f7-94c8-038efa832132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:02.901494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1008/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:02 2022] DELETE /identity/v3/projects/bc5492cf8b714b06a41fda3bcaf404f8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:02.901494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:02.901494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:02.901494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:02.924246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:02.925411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:02.943209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9dd55-2724-45d4-a7f3-1e55c3ae9beb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:03.071345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1009/1999] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:03.076086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:03.078532 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:03.088150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:03.088862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:03.089176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:03.089426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] PATH_INFO: `/v3/projects/d825281518d14a9097ae4def21523071` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:03.093141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d825281518d14a9097ae4def21523071)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:03.095329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:03.109011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cd6f2-5ec8-4ac9-b9d5-745d7bf50e9e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:03.121486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:03.122147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:03.122428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:03.122701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] PATH_INFO: `/v3/users/0d702b47e0c648c899fee01551ce5ac2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:03.124242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d702b47e0c648c899fee01551ce5ac2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:03.127060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:03.194205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd825281518d14a9097ae4def21523071', 'request_id': 'req-97210ad3-8a19-4059-9b5c-18bef5703b1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.214996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd825281518d14a9097ae4def21523071', 'request_id': 'req-97210ad3-8a19-4059-9b5c-18bef5703b1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.227087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd825281518d14a9097ae4def21523071', 'request_id': 'req-97210ad3-8a19-4059-9b5c-18bef5703b1b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.241780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d702b47e0c648c899fee01551ce5ac2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.245326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] The token cache is being invalidate because project d825281518d14a9097ae4def21523071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:03.245913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.246734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.248309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 991/2000] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:02 2022] DELETE /identity/v3/projects/d825281518d14a9097ae4def21523071 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:03.249103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:03.250463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:03.260994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d702b47e0c648c899fee01551ce5ac2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.261722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d702b47e0c648c899fee01551ce5ac2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.262422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d702b47e0c648c899fee01551ce5ac2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.271267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d702b47e0c648c899fee01551ce5ac2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.292716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1010/2001] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:03 2022] DELETE /identity/v3/users/0d702b47e0c648c899fee01551ce5ac2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:03.293810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:03.295388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:03.326012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:03.334675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97210ad3-8a19-4059-9b5c-18bef5703b1b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:03.379503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:03.420209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ca52-b817-4fc7-a9fc-df635219801b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:03.439930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:03.440592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:03.440911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:03.441189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] PATH_INFO: `/v3/users/c0d047de2f594210966c6df454c329d4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:03.449712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d047de2f594210966c6df454c329d4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:03.451403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:03.467853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:03.468368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:03.468688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:03.468956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:03.472830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:03.492802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:03.496045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:03.512392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 992/2002] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:03.529162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d047de2f594210966c6df454c329d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.540075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d047de2f594210966c6df454c329d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.541024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d047de2f594210966c6df454c329d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.542665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d047de2f594210966c6df454c329d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.552955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d047de2f594210966c6df454c329d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:03.573914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1011/2003] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:03 2022] DELETE /identity/v3/users/c0d047de2f594210966c6df454c329d4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:03.940058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:03.946726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:03.962746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b8f0-1f38-49fb-b751-7be1215f31fd service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.057398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.058050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.058329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.058599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] PATH_INFO: `/v3/projects/81cd9913eb9843a5838861833b8b74bb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.059732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cd9913eb9843a5838861833b8b74bb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.061742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.144562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cd9913eb9843a5838861833b8b74bb', 'request_id': 'req-3a489064-84e8-4e6f-9437-5b74d9b8895a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.157670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cd9913eb9843a5838861833b8b74bb', 'request_id': 'req-3a489064-84e8-4e6f-9437-5b74d9b8895a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.177316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cd9913eb9843a5838861833b8b74bb', 'request_id': 'req-3a489064-84e8-4e6f-9437-5b74d9b8895a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.200699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] The token cache is being invalidate because project 81cd9913eb9843a5838861833b8b74bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:04.200699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.200699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-3a489064-84e8-4e6f-9437-5b74d9b8895a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.202123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 993/2004] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:03 2022] DELETE /identity/v3/projects/81cd9913eb9843a5838861833b8b74bb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:04.208368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.209807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.221833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.222416 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.222700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.247773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc9ac-eb6d-488d-bd54-a24357c32a0f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.302763 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] MFA Rules not processed for user `439c49c0d87a4764b0c7c71d40c23071`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:04.309050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.415643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:04.427765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.428512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.428896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.429251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] PATH_INFO: `/v3/users/264ac4e95cf541fe9b9cae6e3efb05f1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.435905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264ac4e95cf541fe9b9cae6e3efb05f1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.438061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.465587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 994/2005] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:04.467294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.471661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.490817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7f7f-eb91-4852-ad21-5cbf37347f3d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.497245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.497986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.498352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.498626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] PATH_INFO: `/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.499832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a9d64ffe464bc4b342dbdbc858649c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.503353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.521504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264ac4e95cf541fe9b9cae6e3efb05f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.535180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264ac4e95cf541fe9b9cae6e3efb05f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.536624 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264ac4e95cf541fe9b9cae6e3efb05f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.538335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264ac4e95cf541fe9b9cae6e3efb05f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.549549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264ac4e95cf541fe9b9cae6e3efb05f1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.551863 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:04.580743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1012/2006] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:04 2022] DELETE /identity/v3/users/264ac4e95cf541fe9b9cae6e3efb05f1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:04.584777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.586600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.616781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a9d64ffe464bc4b342dbdbc858649c', 'request_id': 'req-bcf15070-35a5-437d-833e-25088eda1da0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.624915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a9d64ffe464bc4b342dbdbc858649c', 'request_id': 'req-bcf15070-35a5-437d-833e-25088eda1da0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.635244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a9d64ffe464bc4b342dbdbc858649c', 'request_id': 'req-bcf15070-35a5-437d-833e-25088eda1da0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.654690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] The token cache is being invalidate because project b3a9d64ffe464bc4b342dbdbc858649c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:04.655233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.656555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bcf15070-35a5-437d-833e-25088eda1da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.663106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 995/2007] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:04 2022] DELETE /identity/v3/projects/b3a9d64ffe464bc4b342dbdbc858649c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:04.664925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674acc2-fc5e-460f-97cf-e3070b3bd5d1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.665214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674acc2-fc5e-460f-97cf-e3070b3bd5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.665490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674acc2-fc5e-460f-97cf-e3070b3bd5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.694586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d674acc2-fc5e-460f-97cf-e3070b3bd5d1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:04.695959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d674acc2-fc5e-460f-97cf-e3070b3bd5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.702663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c138f-4f49-4876-85f6-8c8bcbfea7c9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.800251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 996/2008] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:04.801404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.802321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.802604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.814015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.814740 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.828903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.829540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] PATH_INFO: `/v3/projects/eef781a2c35a43359fd52ab6f50adee8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.837999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef781a2c35a43359fd52ab6f50adee8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.841667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:04.842905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:04.848091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.853701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 997/2009] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:04.858061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.873643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537e09-c3b1-4f27-a560-05e5eb840672 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.883611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.884448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.884951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.885226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.885941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:04.886251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.887977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.904574 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 998/2010] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:23:04.909464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.923714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293885b-cab8-4d68-b548-82a28811da84 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:04.929395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:04.930242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:04.939980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:04.940291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:04.941029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:04.943087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:04.979227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef781a2c35a43359fd52ab6f50adee8', 'request_id': 'req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.981779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 999/2011] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:04 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:04.982641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:04.986928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef781a2c35a43359fd52ab6f50adee8', 'request_id': 'req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:04.999344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef781a2c35a43359fd52ab6f50adee8', 'request_id': 'req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:05.012681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:05.016795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] The token cache is being invalidate because project eef781a2c35a43359fd52ab6f50adee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:05.017162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:05.018637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2421d30a-0e1c-47e2-9ce8-bfb50fd32a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:05.021393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1013/2012] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:04 2022] DELETE /identity/v3/projects/eef781a2c35a43359fd52ab6f50adee8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:05.028425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5550-25b5-471e-9c96-45fabf36dc6f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.028765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5550-25b5-471e-9c96-45fabf36dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.029109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5550-25b5-471e-9c96-45fabf36dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.060536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24ae0-ee02-4a5c-ac5c-bbf42575e3aa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.061668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3f1c5550-25b5-471e-9c96-45fabf36dc6f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:05.064314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3f1c5550-25b5-471e-9c96-45fabf36dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.070170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.071026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.071465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.072045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.072898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.073928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1014/2013] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:05.075447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.082157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.082447 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.082728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.109680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:05.110676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1000/2014] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:04 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:05.112245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.114053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.116314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.124610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1015/2015] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:05.130170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.135188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5c22-22b2-42a5-98fb-04be9597735a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.142983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.143904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.144395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.144850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.145029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf4af-3fff-4f22-8bf0-cf288d1ffb30 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.146033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.148161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.152816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.153645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.153932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.154204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.157150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:05.157608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.159258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.161033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:05.169097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1001/2016] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:05.173645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.181516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1016/2017] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:23:05.186340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.194192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e18a9-3880-4863-b200-9e554f59bd63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.200900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be3c0-794e-48dc-b5fb-568506e31d7c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.201152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.202085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.202517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.203084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.204398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.206242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.208409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.209229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.210355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.210649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.211300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.214437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.222978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1002/2018] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:05.230895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.245653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fabde-0ebb-4844-b828-6482b2c07db7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.251853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.252804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.253179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.253556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] PATH_INFO: `/v3/projects/68fc6347e0f44f5eaa10e8b420e4cf87/users/7c39e9d660d14971b2fdd362482bf20e/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.257259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1017/2019] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:05.258211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.274636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fc6347e0f44f5eaa10e8b420e4cf87, user_id=7c39e9d660d14971b2fdd362482bf20e, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.278155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3bdb5-facc-4bf9-9376-dc8b14f4b056 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.322886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1003/2020] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:05 2022] PUT /identity/v3/projects/68fc6347e0f44f5eaa10e8b420e4cf87/users/7c39e9d660d14971b2fdd362482bf20e/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:05.324501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.327231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.327633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.336488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322fa89-b516-49e9-b486-a143e0482d9c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.358808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:05.360379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.403195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.404073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.404519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.404835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.405472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.408460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.444404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1018/2021] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:05.448350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.458887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1004/2022] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:05.470109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.471807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.471988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eeb9c2-5ed8-435a-a58a-f21c728ab6e0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.477644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.478238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.478739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.479601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.480334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.482370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.501533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1019/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:05.502567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.515860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ced99-066f-4f32-a107-6cae095cd42c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.523764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.524506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.524880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.525215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.526102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.527982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.563346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1020/2024] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:05.567477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.579699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee08b8-a783-4ae6-abb2-2d767edf5188 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.585146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.586020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.586441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.587072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.592178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611080a-3217-46b0-a7b4-d2bf0a6d753b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.604571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.605533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.606355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.606703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.607044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] PATH_INFO: `/v3/projects/3d068cc8133c420eb747cb6013dc6f3a/users/9cf7411d5e5446bd9d6f3a95a83d92d4/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.607631 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948cec6-3362-469f-a0dc-368154910adf service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.626201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1005/2025] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:05.630281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d068cc8133c420eb747cb6013dc6f3a, user_id=9cf7411d5e5446bd9d6f3a95a83d92d4, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.633300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.651478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1021/2026] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:05 2022] PUT /identity/v3/projects/3d068cc8133c420eb747cb6013dc6f3a/users/9cf7411d5e5446bd9d6f3a95a83d92d4/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:05.662883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.663226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.663570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.686049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:05.699871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] MFA Rules not processed for user `9cf7411d5e5446bd9d6f3a95a83d92d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:05.701607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.763085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.764929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.818071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1006/2027] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:05.822714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:05.826472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:05.914032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329419a-443b-4135-acb5-f6426f8e349d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.928995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.931713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.933032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.933330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] PATH_INFO: `/v3/projects/952162c7dda44bffa7cf7b3c77d9e625` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.937146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=952162c7dda44bffa7cf7b3c77d9e625)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.943319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:05.961675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5cbe-1d57-4add-950c-57795b14ed6f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:05.971312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:05.972306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.972844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.973332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.974176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:05.976965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.017077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1007/2028] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:06.021757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.131910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952162c7dda44bffa7cf7b3c77d9e625', 'request_id': 'req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.145306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952162c7dda44bffa7cf7b3c77d9e625', 'request_id': 'req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.161780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952162c7dda44bffa7cf7b3c77d9e625', 'request_id': 'req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.180564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] The token cache is being invalidate because project 952162c7dda44bffa7cf7b3c77d9e625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:06.180969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.181648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.184534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1022/2029] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:05 2022] DELETE /identity/v3/projects/952162c7dda44bffa7cf7b3c77d9e625 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:06.189108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.193342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:06.247761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858937-015f-4656-a0e5-2c374e9d717a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.322307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f8aa2-ce71-407a-bf03-9fe401f938fe admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.324967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:06.342111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.342774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.343053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.343324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] PATH_INFO: `/v3/users/95e54dacfb5f4d2cb852a37c5d1fef91` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.345127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e54dacfb5f4d2cb852a37c5d1fef91)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.352025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.376914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.377948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.378774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.379280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.381394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.383986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.446518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1008/2030] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:06 2022] POST /identity/v3/users => generated 290 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:06.453134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.458161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:06.464159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e54dacfb5f4d2cb852a37c5d1fef91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.476819 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e54dacfb5f4d2cb852a37c5d1fef91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.477681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e54dacfb5f4d2cb852a37c5d1fef91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.478997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e54dacfb5f4d2cb852a37c5d1fef91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.481811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:06.484077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778418-d9f3-46d7-92e1-3b16e9cc7341 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.497453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e54dacfb5f4d2cb852a37c5d1fef91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:06.498486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.499077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.499366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.499647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.500412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.505647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.527822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1009/2031] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:06.531401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.538013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:06.550795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1023/2032] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:06 2022] DELETE /identity/v3/users/95e54dacfb5f4d2cb852a37c5d1fef91 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:06.565146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766774-c450-4afd-aa02-2cb0de7ee699 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.725901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.726798 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.727076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.727348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.728007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.729709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7d3b-f1d9-41ba-a007-ee4ac73b19ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.750157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1010/2033] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:06.752038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.772114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc62f-918a-4dcb-92eb-79224a9d4ac8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.785119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.785778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.786060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.786327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] PATH_INFO: `/v3/projects/59706eb45a7242758e06e27717206ed0/users/2c680aa445e545dd9f481e996f3d399d/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.834187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59706eb45a7242758e06e27717206ed0, user_id=2c680aa445e545dd9f481e996f3d399d, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.842154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.875380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1024/2034] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:06 2022] PUT /identity/v3/projects/59706eb45a7242758e06e27717206ed0/users/2c680aa445e545dd9f481e996f3d399d/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:06.890817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd4b0-be8f-423c-828f-a3b2284d115a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.892714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd4b0-be8f-423c-828f-a3b2284d115a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.893101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd4b0-be8f-423c-828f-a3b2284d115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.970142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06cbd4b0-be8f-423c-828f-a3b2284d115a None None] MFA Rules not processed for user `2c680aa445e545dd9f481e996f3d399d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:06.987394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06cbd4b0-be8f-423c-828f-a3b2284d115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:07.178707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.178987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1011/2035] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:07.352124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11133845-ebc1-4ab0-82c9-b24de5984835 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.381206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.381206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.381206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.381206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.381856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.385758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.386037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.386309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.398492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.456697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] MFA Rules not processed for user `7c39e9d660d14971b2fdd362482bf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:07.456697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:07.478051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1025/2036] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:07.482238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.535361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:07.627363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6490-2736-4d46-b349-ba259195c77e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.632985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1012/2037] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:07.634075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.634710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.634992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.635263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.635900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.640453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.643730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.648720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:07.673482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faad1b-69da-493b-b611-32a2f246e1a0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.678567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1026/2038] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:07.679919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.682369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.683263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.683736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.684357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.685305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.687452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.692450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17168283-7b74-4934-9eb5-29b90843775f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.698897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.700274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.700780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.701205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.702511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.705356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.728000 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1027/2039] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:07.742401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.745352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1013/2040] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:07.748452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.771982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b68eb-53e4-47bb-b3ab-5cf3725a140f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.795985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:07.860476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0dad9-b735-4125-b7a7-6878c61a1d03 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.866621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.867401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.868310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.868310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.869201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.871463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.899418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1014/2041] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:07.903258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.914462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b71e-0938-482d-aaa8-29d6aec1aab7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.918807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.920017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.920305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.920415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.920581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] PATH_INFO: `/v3/projects/342fdc0464814143af3bbbadee60ad52/users/6440b3f2c4ad44df9555f417aa8533d4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.921286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.921630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.921971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.922860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.924692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.940785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1015/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:07.941989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.945009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342fdc0464814143af3bbbadee60ad52, user_id=6440b3f2c4ad44df9555f417aa8533d4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.948889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.955761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af57474-c0f4-4737-9dc6-e574b73d2dd0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.963064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.963966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.964086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.964269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] PATH_INFO: `/v3/projects/d328f6c0e60249c184b1f3c386fc4891/users/8a991955d910483eacb525118db28f07/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.971955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1028/2043] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:07 2022] PUT /identity/v3/projects/342fdc0464814143af3bbbadee60ad52/users/6440b3f2c4ad44df9555f417aa8533d4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:07.975881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.987558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d328f6c0e60249c184b1f3c386fc4891, user_id=8a991955d910483eacb525118db28f07, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.990327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.013894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1016/2044] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:07 2022] PUT /identity/v3/projects/d328f6c0e60249c184b1f3c386fc4891/users/8a991955d910483eacb525118db28f07/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:08.018997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.056303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32d60-f130-47c7-84c0-2228e292fe12 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.099219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:08.108461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f2eb-2ca6-4bd7-a247-592c19e7311b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.136191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.136881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.137156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.137547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.138256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.139179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.139988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.140584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.141347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.141769 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.143274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.145122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.161450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1017/2045] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:08.162594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.165170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:08.168705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1029/2046] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:08.168705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.181588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51d08-4917-4c1e-910a-0e0714c1341f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.182569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064e9b-99e5-4b57-937d-fc1c26951799 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.188324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.188879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.189217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.189494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.189591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.189822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.190067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] PATH_INFO: `/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.190193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] PATH_INFO: `/v3/projects/d328f6c0e60249c184b1f3c386fc4891/users/8a991955d910483eacb525118db28f07/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.191991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea13229ea0704cdd9cc43cfb701aac4e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.192154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d328f6c0e60249c184b1f3c386fc4891, user_id=8a991955d910483eacb525118db28f07, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.194162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.194888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.206586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1030/2047] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:08 2022] PUT /identity/v3/projects/d328f6c0e60249c184b1f3c386fc4891/users/8a991955d910483eacb525118db28f07/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:08.208800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.274230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:08.294134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea13229ea0704cdd9cc43cfb701aac4e', 'request_id': 'req-8248d173-d08f-4be9-b3e8-52cc371bf0cc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:08.318695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea13229ea0704cdd9cc43cfb701aac4e', 'request_id': 'req-8248d173-d08f-4be9-b3e8-52cc371bf0cc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:08.331469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea13229ea0704cdd9cc43cfb701aac4e', 'request_id': 'req-8248d173-d08f-4be9-b3e8-52cc371bf0cc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:08.340931 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a9a3-96c3-4c95-9034-dc127b97dbc2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.374209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] The token cache is being invalidate because project ea13229ea0704cdd9cc43cfb701aac4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:08.374582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:08.380259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8248d173-d08f-4be9-b3e8-52cc371bf0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:08.381972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1018/2048] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:08 2022] DELETE /identity/v3/projects/ea13229ea0704cdd9cc43cfb701aac4e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:08.386664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde8e-025e-45e4-a6e7-9f12fb15edef None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.386949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde8e-025e-45e4-a6e7-9f12fb15edef None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.387222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde8e-025e-45e4-a6e7-9f12fb15edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.410895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-980bde8e-025e-45e4-a6e7-9f12fb15edef None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:08.412203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-980bde8e-025e-45e4-a6e7-9f12fb15edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:08.445047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.446240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.446751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.447223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] PATH_INFO: `/v3/projects/342fdc0464814143af3bbbadee60ad52/users/6440b3f2c4ad44df9555f417aa8533d4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.449554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342fdc0464814143af3bbbadee60ad52, user_id=6440b3f2c4ad44df9555f417aa8533d4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.455290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614600c-ecae-429b-a8db-01e70f5ebe05 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.468535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1031/2049] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:08 2022] PUT /identity/v3/projects/342fdc0464814143af3bbbadee60ad52/users/6440b3f2c4ad44df9555f417aa8533d4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:08.480173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.481095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.482616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.559439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] MFA Rules not processed for user `6440b3f2c4ad44df9555f417aa8533d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:08.561148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:08.601312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1019/2050] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:08.609345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.609696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.609969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.676735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:08.684203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:08.814032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1020/2051] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:08.815413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.827761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1032/2052] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:08.829214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.829741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b39b-6e00-42c5-9c8c-41f9eee5db02 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.831636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:08.836094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.839383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.839767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.840096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.841123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:08.841496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.843246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.864916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1021/2053] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:23:08.886151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:08.900515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:08.912951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e2ab-0847-483a-8e15-49a2be13b991 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.929367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.929977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.930257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.931939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:08.932666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:08.938971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:08.982071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474fa6-3a77-4ff5-8639-71dc8e5a79e7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:08.994386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:08.995105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:08.995892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:08.996869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.004770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1022/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:08 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:09.010899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:09.011232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.018621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.018621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.032245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1033/2055] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:09.093213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.107607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e876-b93f-422d-bb66-5861d7063c7f service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.155227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb428f6-d9a8-4a6e-acdf-27e60d47fc0d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.169026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.170807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.171729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.172613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.174638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.177918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.212627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1023/2056] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:09 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:09.212865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.213292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.213572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.213845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.216818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.217526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:09.262938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b971a-1037-492b-8fc0-90c6b8d4ff47 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.277091 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.278071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.278350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.278617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.279607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.282704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.293984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.295815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.306297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1024/2057] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:09.308241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1034/2058] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:09.309967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.329861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db662cb-ed3c-4063-8f50-3d00ff264077 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.335971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.337228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.338396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.338675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.340057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.342119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d58bf7-a816-4305-a93e-356ad19dfaa4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.403427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1025/2059] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:09.407940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.428218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788713c-e83a-45dc-99f8-692b3c20d428 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.443663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.444456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.444889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.446810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] PATH_INFO: `/v3/projects/ee32fa0b38d544e1bd9a470a56b5deff/users/cfce2e6000b841568372ad9ada2795be/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.485704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee32fa0b38d544e1bd9a470a56b5deff, user_id=cfce2e6000b841568372ad9ada2795be, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.490870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:09.510962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1035/2060] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:09 2022] PUT /identity/v3/projects/ee32fa0b38d544e1bd9a470a56b5deff/users/cfce2e6000b841568372ad9ada2795be/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:09.522293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.522663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.523022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.575699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] MFA Rules not processed for user `cfce2e6000b841568372ad9ada2795be`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:09.577526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:09.696824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1026/2061] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:09.832991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:09.836887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:09.964001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af95362-fb25-497c-abdd-4cf005bb422c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:09.970847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:09.971469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:09.971744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:09.972011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:09.987548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:09.989492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b96b-b66b-4f27-a1ce-0597111bf0d6 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:10.020019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1036/2062] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:10.038499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:10.105995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:10.137972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02561-0e41-44ab-9327-d79a8a934231 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:10.143790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:10.144564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:10.144925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:10.145268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] PATH_INFO: `/v3/users/cfce2e6000b841568372ad9ada2795be` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:10.146927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfce2e6000b841568372ad9ada2795be)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:10.149059 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:10.214503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfce2e6000b841568372ad9ada2795be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:10.223723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfce2e6000b841568372ad9ada2795be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:10.236686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfce2e6000b841568372ad9ada2795be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:10.237236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfce2e6000b841568372ad9ada2795be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:10.237864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfce2e6000b841568372ad9ada2795be'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:10.264764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1027/2063] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:10 2022] DELETE /identity/v3/users/cfce2e6000b841568372ad9ada2795be => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:10.270243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913cef-d53b-4c12-9496-7aed9331c79f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:10.270483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913cef-d53b-4c12-9496-7aed9331c79f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:10.271019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913cef-d53b-4c12-9496-7aed9331c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:10.293012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc913cef-d53b-4c12-9496-7aed9331c79f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:10.294345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc913cef-d53b-4c12-9496-7aed9331c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:10.321557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:10.389756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1037/2064] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:10.400394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:10.401904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:10.472936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e33ca-6bdb-419e-9e78-abcd78f3967f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:10.477010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:10.477693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:10.478040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:10.478322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:10.488098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:10.489579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595d51d-01da-469b-9506-578175427a4c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:10.499211 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1028/2065] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:10.680045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:10.680505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:10.680582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:10.738773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] MFA Rules not processed for user `8a991955d910483eacb525118db28f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:10.740003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:10.891988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1038/2066] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:10.893767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:10.894678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:10.894941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:10.930608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] MFA Rules not processed for user `7c39e9d660d14971b2fdd362482bf20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:10.931999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.029299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1029/2067] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:11.041961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.042774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.043670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.046429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.081532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aad1c-af02-4ae3-99b0-071abdd4fbc4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.097065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.097692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.097967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.098237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] PATH_INFO: `/v3/projects/ee32fa0b38d544e1bd9a470a56b5deff` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.101689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee32fa0b38d544e1bd9a470a56b5deff)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.105957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.109341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:11.197941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee32fa0b38d544e1bd9a470a56b5deff', 'request_id': 'req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:11.198309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c8a5b-9a7a-42b5-800b-d433ad2086ca None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.215808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee32fa0b38d544e1bd9a470a56b5deff', 'request_id': 'req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:11.236084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee32fa0b38d544e1bd9a470a56b5deff', 'request_id': 'req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:11.266896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] The token cache is being invalidate because project ee32fa0b38d544e1bd9a470a56b5deff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:11.267217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:11.268006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ade9102-9dbe-4aa6-b02f-4c7355db5cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:11.277994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1030/2068] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:11 2022] DELETE /identity/v3/projects/ee32fa0b38d544e1bd9a470a56b5deff => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:11.286165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.286450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.286728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.290417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:11.317060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.317880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.318209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.318490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.320533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.338625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:11.339883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.442222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.444522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c743c2-153d-44ed-bdb1-ee208a057982 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.461272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1039/2069] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:11.548578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1031/2070] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:11.557881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.558528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.558951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.605746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:11.607323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.639904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1040/2071] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:11.645208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.661806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a13b5-63fa-4eb1-863b-921296861526 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.678274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.678850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.679213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.679492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.680291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:11.680598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.682441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.709502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1032/2072] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:11.714525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.730704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c400831-fbbc-45e5-b1d1-f20818a88eec None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.737491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.738313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.739704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.740255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.741102 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.743344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.811569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1041/2073] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:11 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:11.812788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.826570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc407-ff8d-43bf-91db-89930d0f5233 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.927482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.928787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.929343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.929941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.930944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.934773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.982305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.993595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1033/2074] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:11 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:12.004434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f045-0364-4ccd-8f2f-b05dba3c40b1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:12.010622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:12.011903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:12.012959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:12.013239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:12.014175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:12.016951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:12.033989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1042/2075] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:12.035648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:12.050823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cea111-1cf7-41df-874e-ca563bf70f3f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:12.057272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:12.057899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:12.058179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:12.058448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:12.059122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:12.060775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad814-8543-434e-ad80-b71e3f5c7152 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:12.063289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:12.083716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:12.084444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1034/2076] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:12.095943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-b698-477d-b6a3-2cfda8dd2e99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:12.103352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:12.104158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:12.104462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:12.104750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] PATH_INFO: `/v3/projects/ccc4f69bf46648f58b0eb0a4a3df11ba/users/06cb3c63b19b43d6a2655aec32bfb3d8/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:12.136858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc4f69bf46648f58b0eb0a4a3df11ba, user_id=06cb3c63b19b43d6a2655aec32bfb3d8, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:12.141737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:12.159557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1043/2077] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:12 2022] PUT /identity/v3/projects/ccc4f69bf46648f58b0eb0a4a3df11ba/users/06cb3c63b19b43d6a2655aec32bfb3d8/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:12.170076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:12.170357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:12.170624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:12.212452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] MFA Rules not processed for user `06cb3c63b19b43d6a2655aec32bfb3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:12.213833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:12.292809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1035/2078] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:12.308762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:12.310835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:12.378933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e227a1-1dac-451b-aa39-86024d3dd223 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:12.382771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:12.383516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:12.384515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:12.384853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:12.395639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:12.397245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a484-7dc0-42de-a19c-301105056f73 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:12.418721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1044/2079] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:13.095438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:13.101214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:13.192770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061dbe-9fd7-4906-abbb-84112efb5be9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:13.198198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:13.198842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:13.199130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:13.199410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] PATH_INFO: `/v3/users/9cf7411d5e5446bd9d6f3a95a83d92d4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:13.200490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf7411d5e5446bd9d6f3a95a83d92d4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:13.202495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:13.260738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf7411d5e5446bd9d6f3a95a83d92d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.271242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf7411d5e5446bd9d6f3a95a83d92d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.279411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf7411d5e5446bd9d6f3a95a83d92d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.279585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf7411d5e5446bd9d6f3a95a83d92d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.280463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf7411d5e5446bd9d6f3a95a83d92d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.303710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1036/2080] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:13 2022] DELETE /identity/v3/users/9cf7411d5e5446bd9d6f3a95a83d92d4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:13.308043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:13.308522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:13.308598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:13.331328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:13.332574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:13.354544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:13.401996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1045/2081] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:13.411928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:13.418671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:13.421284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:13.481203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a051-a566-4e1f-9b1b-87d83ac78af3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:13.485395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:13.486993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:13.487268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:13.487533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:13.496835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:13.498275 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:13.507640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1037/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:13.882172 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:13.883629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:13.906675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda423f-7ad2-4225-8fc3-3c1aaf874daa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:13.915389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:13.916034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:13.916353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:13.916580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] PATH_INFO: `/v3/projects/3d068cc8133c420eb747cb6013dc6f3a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:13.917745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d068cc8133c420eb747cb6013dc6f3a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:13.919683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:13.970319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d068cc8133c420eb747cb6013dc6f3a', 'request_id': 'req-ddce785a-4284-4b0d-ad85-6f7007f82b0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.976192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d068cc8133c420eb747cb6013dc6f3a', 'request_id': 'req-ddce785a-4284-4b0d-ad85-6f7007f82b0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.984225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d068cc8133c420eb747cb6013dc6f3a', 'request_id': 'req-ddce785a-4284-4b0d-ad85-6f7007f82b0f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.996594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] The token cache is being invalidate because project 3d068cc8133c420eb747cb6013dc6f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:13.996944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.997631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:13.999138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1046/2083] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:13 2022] DELETE /identity/v3/projects/3d068cc8133c420eb747cb6013dc6f3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:14.003691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:14.013495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7e0e-b214-48df-965c-210b48f747db service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:14.072834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:14.073741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:14.074020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:14.074294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] PATH_INFO: `/v3/users/2c680aa445e545dd9f481e996f3d399d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:14.075425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c680aa445e545dd9f481e996f3d399d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:14.077406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:14.131613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c680aa445e545dd9f481e996f3d399d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.150518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c680aa445e545dd9f481e996f3d399d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.164980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c680aa445e545dd9f481e996f3d399d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.166519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c680aa445e545dd9f481e996f3d399d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.167219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c680aa445e545dd9f481e996f3d399d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.190333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1038/2084] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:14 2022] DELETE /identity/v3/users/2c680aa445e545dd9f481e996f3d399d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:14.527436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:14.529570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:14.548953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce785a-4284-4b0d-ad85-6f7007f82b0f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:14.613583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:14.614225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:14.614504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:14.614864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] PATH_INFO: `/v3/projects/59706eb45a7242758e06e27717206ed0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:14.616013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59706eb45a7242758e06e27717206ed0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:14.618236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:14.671539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59706eb45a7242758e06e27717206ed0', 'request_id': 'req-5fcf1175-25f8-4c17-9e80-c0edab925588'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.674138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:14.678666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59706eb45a7242758e06e27717206ed0', 'request_id': 'req-5fcf1175-25f8-4c17-9e80-c0edab925588'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.688349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59706eb45a7242758e06e27717206ed0', 'request_id': 'req-5fcf1175-25f8-4c17-9e80-c0edab925588'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.700393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] The token cache is being invalidate because project 59706eb45a7242758e06e27717206ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:14.700731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.701999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.704041 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1047/2085] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:14 2022] DELETE /identity/v3/projects/59706eb45a7242758e06e27717206ed0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:14.709098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:14.709328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:14.723831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2898ba-6bfd-4e9a-b2f6-49fa88e9c8e3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:14.750220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:14.800993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:14.802273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:14.802567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:14.802844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] PATH_INFO: `/v3/users/6440b3f2c4ad44df9555f417aa8533d4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:14.804038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6440b3f2c4ad44df9555f417aa8533d4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:14.806027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:14.860495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6440b3f2c4ad44df9555f417aa8533d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.869879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6440b3f2c4ad44df9555f417aa8533d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.878387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6440b3f2c4ad44df9555f417aa8533d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.879191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6440b3f2c4ad44df9555f417aa8533d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.879720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-700b7b12-2cb5-42de-b3eb-ff52ecf1dfd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6440b3f2c4ad44df9555f417aa8533d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:14.917279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1039/2086] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:14 2022] DELETE /identity/v3/users/6440b3f2c4ad44df9555f417aa8533d4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:15.200789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.202224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:15.217809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1175-25f8-4c17-9e80-c0edab925588 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.276089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.276632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.276933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.277201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] PATH_INFO: `/v3/projects/342fdc0464814143af3bbbadee60ad52` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.278291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342fdc0464814143af3bbbadee60ad52)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.280181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.332317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342fdc0464814143af3bbbadee60ad52', 'request_id': 'req-68bcab8e-68fd-48db-a17f-f7d4a830d111'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:15.338279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342fdc0464814143af3bbbadee60ad52', 'request_id': 'req-68bcab8e-68fd-48db-a17f-f7d4a830d111'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:15.345964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342fdc0464814143af3bbbadee60ad52', 'request_id': 'req-68bcab8e-68fd-48db-a17f-f7d4a830d111'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:15.358257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] The token cache is being invalidate because project 342fdc0464814143af3bbbadee60ad52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:15.358545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:15.359192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-68bcab8e-68fd-48db-a17f-f7d4a830d111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:15.361303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1048/2087] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:15 2022] DELETE /identity/v3/projects/342fdc0464814143af3bbbadee60ad52 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:15.367234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.367673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.367812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.387663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:15.388796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:15.454151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1040/2088] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:15.463762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.464529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.464529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.485859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:15.487077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:15.495818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1049/2089] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:15.500160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.509832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226872b-01fc-4bea-bdcb-81a0770a00cf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.514503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.515108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.515388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.515686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.516334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:15.516630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.518322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.535303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1041/2090] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:15.536462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.546549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46f30-7666-4aef-88c2-312675b8c45c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.553235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.555200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.556048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.556339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.557017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.558939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.592750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1050/2091] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:15.594566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.606067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0e1a0-312d-4377-abdd-1ab2842b5375 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.642893 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:15.680501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.681171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.681449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.681719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.682373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.684371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.710796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1042/2092] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:15.715054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.730487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ba4a-3d3b-4b4c-ae24-4248cfbd77f3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.736163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.736801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.737078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.737344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.737991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.739664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.752573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1051/2093] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:15.758097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.771758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1f6a-d0d7-49ce-a181-16b10f93e564 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.797613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.797613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.797613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.797613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.798254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.798605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1316d74-1069-4c5b-b5c6-0b585dba5157 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.817582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:15.823786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1043/2094] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:15.828541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db181-c63d-408b-9650-6bca8fc9c512 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:15.833930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:15.834591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.834918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.835242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] PATH_INFO: `/v3/projects/ddad9bf9947a4dcc8ff445cb8f60aba6/users/3ea9ea8e32444c0ca458b2a63c851632/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.855710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddad9bf9947a4dcc8ff445cb8f60aba6, user_id=3ea9ea8e32444c0ca458b2a63c851632, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:15.859190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:15.877566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1052/2095] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:15 2022] PUT /identity/v3/projects/ddad9bf9947a4dcc8ff445cb8f60aba6/users/3ea9ea8e32444c0ca458b2a63c851632/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:15.888826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:15.889409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:15.889993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:15.924165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] MFA Rules not processed for user `3ea9ea8e32444c0ca458b2a63c851632`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:15.925474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:15.993356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1044/2096] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:15.997886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.007764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:16.064158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9815-5222-42d9-8380-a9109ecedf40 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.068755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.069354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.069632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.069904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.070623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.072513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.100400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1053/2097] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:15 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:16.104852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.116449 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8edfb-d288-4f6e-8faa-975b61fb3b39 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.176215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.176855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.177139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.177410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.178036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.179994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.203222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1045/2098] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:16 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:16.207488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.217718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e4ef-7f48-483b-b370-4fbb743d0dfc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.223490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.224096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.224485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.224665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.225398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.227257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.238829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1054/2099] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:16.243278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.253727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f1e7-5869-4282-a1b8-c56b20125c52 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.258454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.259112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.259391 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.259664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] PATH_INFO: `/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.274745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2956ccbe316a490aa24b1f5a6cb0b2aa, user_id=fe4ec1a611a04a4d9f8a1ea84f8d33bc, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.277512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.292002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1046/2100] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:16 2022] PUT /identity/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:16.296038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.306777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0fe2-e73f-49ba-93ed-9b666aa85947 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.363199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.363730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.364009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.364281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.364982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.366575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887dd6d-84d8-431f-b873-534758dd6eb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.376750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1055/2101] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:16.380885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.391214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d82af-cabb-46d6-9831-b5253ee85664 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.396029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.396740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.397016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.397289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] PATH_INFO: `/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.399255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2956ccbe316a490aa24b1f5a6cb0b2aa, user_id=fe4ec1a611a04a4d9f8a1ea84f8d33bc, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.401969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.404302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:16.415156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1047/2102] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:16 2022] PUT /identity/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:16.426193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.426478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.426753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.455456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] MFA Rules not processed for user `fe4ec1a611a04a4d9f8a1ea84f8d33bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:16.456667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:16.529501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1056/2103] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:16.541649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:16.543373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:16.603826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19a81-f1fe-48b6-a1f0-8e9a84d088f1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:16.607405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:16.607997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:16.608270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:16.608535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:16.618052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:16.619409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5fe9b-1eee-4e09-af76-fb31d9d64f4c service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:16.631558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1048/2104] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:17.041373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:17.045935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:17.122518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015e36-f1bb-41bb-826f-45cd547889db None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:17.128436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:17.129701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:17.129981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:17.130379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] PATH_INFO: `/v3/users/3ea9ea8e32444c0ca458b2a63c851632` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:17.131521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea9ea8e32444c0ca458b2a63c851632)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:17.133553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:17.196926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea9ea8e32444c0ca458b2a63c851632'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.204633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea9ea8e32444c0ca458b2a63c851632'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.205306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea9ea8e32444c0ca458b2a63c851632'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.205910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea9ea8e32444c0ca458b2a63c851632'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.213098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea9ea8e32444c0ca458b2a63c851632'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.231654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1057/2105] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:17 2022] DELETE /identity/v3/users/3ea9ea8e32444c0ca458b2a63c851632 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:17.237058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:17.237337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:17.237606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:17.257124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:17.258326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:17.321074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1049/2106] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:17.333257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:17.336229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:17.398048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6894-e6b1-4d45-aa7d-acc1bb7b1f15 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:17.402986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:17.403605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:17.404320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:17.404451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:17.418324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:17.418324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:17.444394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1058/2107] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:17.737012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:17.738813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:17.761564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff989-c15d-4469-92ba-4f71fb7343b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:17.788857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:17.788857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:17.788857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:17.788857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] PATH_INFO: `/v3/projects/ddad9bf9947a4dcc8ff445cb8f60aba6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:17.789258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddad9bf9947a4dcc8ff445cb8f60aba6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:17.789258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:17.839777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddad9bf9947a4dcc8ff445cb8f60aba6', 'request_id': 'req-918bf1c6-01e0-4efe-b909-57eaa0df033d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.846362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddad9bf9947a4dcc8ff445cb8f60aba6', 'request_id': 'req-918bf1c6-01e0-4efe-b909-57eaa0df033d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.853945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddad9bf9947a4dcc8ff445cb8f60aba6', 'request_id': 'req-918bf1c6-01e0-4efe-b909-57eaa0df033d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.871251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] The token cache is being invalidate because project ddad9bf9947a4dcc8ff445cb8f60aba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:17.871560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.872200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:17.873910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1050/2108] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:17 2022] DELETE /identity/v3/projects/ddad9bf9947a4dcc8ff445cb8f60aba6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:17.878236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:17.887919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a6eb0-3475-4213-a043-69c8142a222e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:17.909119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:17.952700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:17.953990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:17.954322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:17.954830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] PATH_INFO: `/v3/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:17.955998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4ec1a611a04a4d9f8a1ea84f8d33bc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:17.958096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:18.005682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4ec1a611a04a4d9f8a1ea84f8d33bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.013513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4ec1a611a04a4d9f8a1ea84f8d33bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.014580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4ec1a611a04a4d9f8a1ea84f8d33bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.015211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4ec1a611a04a4d9f8a1ea84f8d33bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.022522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5dd3bf98-2336-4448-a3a4-5edc90a2853f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4ec1a611a04a4d9f8a1ea84f8d33bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.048501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1059/2109] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:17 2022] DELETE /identity/v3/users/fe4ec1a611a04a4d9f8a1ea84f8d33bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:18.678891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:18.680673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:18.710536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bf1c6-01e0-4efe-b909-57eaa0df033d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:18.736205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:18.813813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:18.815196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:18.815661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:18.816232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] PATH_INFO: `/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:18.820225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2956ccbe316a490aa24b1f5a6cb0b2aa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:18.822318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:18.908231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2956ccbe316a490aa24b1f5a6cb0b2aa', 'request_id': 'req-03706ca0-7869-43e1-9057-cf8a620c0aed'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.927265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2956ccbe316a490aa24b1f5a6cb0b2aa', 'request_id': 'req-03706ca0-7869-43e1-9057-cf8a620c0aed'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.939666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2956ccbe316a490aa24b1f5a6cb0b2aa', 'request_id': 'req-03706ca0-7869-43e1-9057-cf8a620c0aed'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.955122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] The token cache is being invalidate because project 2956ccbe316a490aa24b1f5a6cb0b2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:18.955418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.956200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-03706ca0-7869-43e1-9057-cf8a620c0aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:18.958953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1051/2110] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:18 2022] DELETE /identity/v3/projects/2956ccbe316a490aa24b1f5a6cb0b2aa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:18.975091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:18.975368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:18.975639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:18.998058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:18.999324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:19.101822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1060/2111] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:19.110123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.110414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.110702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.149309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:19.152094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:19.164813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1052/2112] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:19.169338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.180331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea25d-1924-443b-85fe-32ddbc7b5061 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.186267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.186879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.187152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.187741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.188412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:19.188744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.190564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.212594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1061/2113] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:23:19.213575 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.232690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65c69-8273-46f4-b3ba-ad25782b1ab9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.242496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.244725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.245109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.245536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.246432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.248814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.292908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1053/2114] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:19.297810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.310928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032649f-44ae-411d-8183-2318d1a520b5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.361177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:19.438456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.439101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.439385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.439717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.440282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.447798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.481351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1062/2115] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:19.481844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.495360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a04dcf-0233-4427-ab0a-f6975e79415a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.500849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.501411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.501697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.501975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.502626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.504587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.516766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1054/2116] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:19.521002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.535200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd5b2-a0d9-4545-8d5e-b6272e2c5cc9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.543224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.544094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.544935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.545421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.547111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.549194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e97582-2b95-4811-9383-e563daf2aec0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.565783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1063/2117] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:19.569885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.583998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f3f7-57dc-4305-abb7-48f6cdd17773 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.590762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.591451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.591720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.591994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] PATH_INFO: `/v3/projects/fd07b95ec5b14410b4427838699b1423/users/54b4875977e540a1b878ee14387c9290/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.610016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd07b95ec5b14410b4427838699b1423, user_id=54b4875977e540a1b878ee14387c9290, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.613344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.664851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1055/2118] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:19 2022] PUT /identity/v3/projects/fd07b95ec5b14410b4427838699b1423/users/54b4875977e540a1b878ee14387c9290/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:19.668480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.668904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.669288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.702672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] MFA Rules not processed for user `54b4875977e540a1b878ee14387c9290`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:19.705367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:19.829684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1064/2119] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:19.834263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.923681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:19.951673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdc4-1af5-4886-a174-f98e8e3123ee admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.958487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.959197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.959703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.960033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.961004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.964814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.017907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1056/2120] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:20.019382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.037258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2ce6c-74a5-45e1-9446-e509c1b9b363 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.203831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.204545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.205785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.207332 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.209326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.214729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.254143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1065/2121] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:20 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:20.262624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.299233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653b5c9-b386-4a93-8ce1-7cc1907b2765 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.319597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.323213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.323502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.323781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.325792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.327440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.347680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.355047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1057/2122] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:20.361999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9681-3655-473a-aab7-a9ef3a72d4db admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.380109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.380832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.381116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.381395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] PATH_INFO: `/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9/users/d6d78c2bd87548348dcb5a3614d48cd5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.429056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe64f41c50504ec9acd0314a2dfc98b9, user_id=d6d78c2bd87548348dcb5a3614d48cd5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.433748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.468243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1066/2123] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:20 2022] PUT /identity/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9/users/d6d78c2bd87548348dcb5a3614d48cd5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:20.472775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.511477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b2f1-c13e-4e98-ad30-cf0c8f72418a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.598152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.599020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.599020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.599314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.599965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.602302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1aac4-ba78-4e3c-ae2e-ef690591cfef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.616218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1058/2124] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:20.618351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.633949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:20.637955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ee61-08db-44e5-88c3-24be67fa5d1f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.644141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.644844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.645176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.645457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] PATH_INFO: `/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9/users/d6d78c2bd87548348dcb5a3614d48cd5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.647403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe64f41c50504ec9acd0314a2dfc98b9, user_id=d6d78c2bd87548348dcb5a3614d48cd5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.650105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.660934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1067/2125] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:20 2022] PUT /identity/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9/users/d6d78c2bd87548348dcb5a3614d48cd5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:23:20.672574 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.672886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.673162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.701519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] MFA Rules not processed for user `d6d78c2bd87548348dcb5a3614d48cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:20.702750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:20.773810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1059/2126] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:20.785160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:20.786907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:20.848908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b1a42-6d60-4625-b950-734731e9fb91 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:20.855991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:20.856515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:20.856841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:20.857093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:20.950717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:20.952475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13bea6-d041-4e90-be1f-c791bd780100 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:20.980220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1068/2127] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:23.137722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:23.139223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.195225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:23.217960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10b70-d2da-4ac2-b10c-e82e5b019e24 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:23.224293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:23.224957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.225232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.226263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] PATH_INFO: `/v3/users/06cb3c63b19b43d6a2655aec32bfb3d8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.228896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cb3c63b19b43d6a2655aec32bfb3d8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:23.237249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:23.296389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cb3c63b19b43d6a2655aec32bfb3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.304258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cb3c63b19b43d6a2655aec32bfb3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.311638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cb3c63b19b43d6a2655aec32bfb3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.312294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cb3c63b19b43d6a2655aec32bfb3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.313133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cb3c63b19b43d6a2655aec32bfb3d8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.332158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1060/2128] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:23 2022] DELETE /identity/v3/users/06cb3c63b19b43d6a2655aec32bfb3d8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:23.336800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.337293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.337389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.363511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:23.364881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.430704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1069/2129] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:23.449215 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:23.451010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.533180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7eeed-8f8a-4d84-aa6f-b867bbeb94db admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:23.536888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:23.537501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.537781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.538056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.549178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:23.550668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106346-6112-4c2b-933d-efb8b80e88a2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:23.563071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1061/2130] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:23.864922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:23.866726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.880888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97d095-679c-4ffb-b51d-476707fb685e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:23.898924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:23.899268 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.899415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.899687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] PATH_INFO: `/v3/projects/ccc4f69bf46648f58b0eb0a4a3df11ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.900888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc4f69bf46648f58b0eb0a4a3df11ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:23.904573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:23.956037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:23.964184 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc4f69bf46648f58b0eb0a4a3df11ba', 'request_id': 'req-d1c45d54-f284-48a8-9de3-937d204b8291'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.973684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc4f69bf46648f58b0eb0a4a3df11ba', 'request_id': 'req-d1c45d54-f284-48a8-9de3-937d204b8291'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.986359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc4f69bf46648f58b0eb0a4a3df11ba', 'request_id': 'req-d1c45d54-f284-48a8-9de3-937d204b8291'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.998391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] The token cache is being invalidate because project ccc4f69bf46648f58b0eb0a4a3df11ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:23.998669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:23.999315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1c45d54-f284-48a8-9de3-937d204b8291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:24.001154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1070/2131] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:23 2022] DELETE /identity/v3/projects/ccc4f69bf46648f58b0eb0a4a3df11ba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:24.006174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.007231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.007231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.031567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:24.033342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:24.107299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1062/2132] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:24.123201 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.123496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.123759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.175587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:24.177146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:24.187350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1071/2133] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:24.193094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.202931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:24.209194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44623-3375-4893-a088-8fd5eebe4817 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.219638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.222140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.222780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.223372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.224433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:24.224980 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.227519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.248488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1063/2134] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:24.255613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.272729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c8062-a692-407c-b047-f2c391a50d32 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.279354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.279982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.280271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.280547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.285081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.288398 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.339135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1072/2135] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:24 2022] POST /identity/v3/projects => generated 397 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:24.340386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.353426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f9257-3784-4684-924f-976e0d12d3af admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.448896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.449775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.450573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.450956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.451775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.456526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.500567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1064/2136] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:24 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:24.504115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.527611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff331-50ea-47a6-b4e6-842089a18aee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.533731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.534700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.535078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.535519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.536345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.544488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.562180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1073/2137] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:23:24.564219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.575910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837cb17-150c-459b-bb8b-f0f051b27550 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.582870 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.583723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.583932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.584257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.585082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.586777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bed19-a851-485b-b255-9e1a462f7370 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.602511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1065/2138] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:24.605125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.618505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b5f1-f826-48b7-9c2f-82cd91eb3e56 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.624998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.626782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.627273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.627762 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] PATH_INFO: `/v3/projects/4e345ed2c1e74d4da0b7fb89d490b75f/users/521b2af01c014ae1988daa3cf2e80e83/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.650228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e345ed2c1e74d4da0b7fb89d490b75f, user_id=521b2af01c014ae1988daa3cf2e80e83, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.653639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.685290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1074/2139] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:24 2022] PUT /identity/v3/projects/4e345ed2c1e74d4da0b7fb89d490b75f/users/521b2af01c014ae1988daa3cf2e80e83/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:24.692149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.692491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.692879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.732201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] MFA Rules not processed for user `521b2af01c014ae1988daa3cf2e80e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:24.733603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:24.827001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1066/2140] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:24.838968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:24.840841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:24.912834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6cb27-5e65-453e-8e21-cd76e222121d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:24.916525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:24.917399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:24.917675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:24.918036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:24.928741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:24.930345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b26a-0c5a-4dc1-8c72-2c3613708a0f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:24.940346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1075/2141] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:25.649588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:25.651103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:25.663656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3b5d-2a0c-4197-8220-b5314dda2f13 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:25.667324 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:25.667942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:25.668213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:25.668479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:25.670253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:25.737184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:25.741083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:25.743353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54903d-5d65-4b55-a2e2-3ff25de3efaf service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:25.758237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1067/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:28.116913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.117449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.117548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.118991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1076/2143] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:28.149914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.150460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.150673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.174610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:28.176232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:28.199235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:28.200983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:28.255330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1068/2144] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:28.267539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:28.269016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:28.275914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f8479-9db4-40f9-a87f-4cf14dea7ffe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:28.280701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:28.281342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.281620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.282030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] PATH_INFO: `/v3/users/53a8aad1e7d34b7c89a3f694cb40261b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.282410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7624e-de87-4f3b-95fa-b146d2eb9b31 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:28.283281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a8aad1e7d34b7c89a3f694cb40261b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:28.285233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:28.287580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:28.288179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.288454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.288751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.296238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:28.297232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:28.298832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:28.309633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1069/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:28.336980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a8aad1e7d34b7c89a3f694cb40261b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.345278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a8aad1e7d34b7c89a3f694cb40261b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.346123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a8aad1e7d34b7c89a3f694cb40261b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.346752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a8aad1e7d34b7c89a3f694cb40261b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.353989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f22f27b7-0546-4bf6-ab7f-cfdac6139438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a8aad1e7d34b7c89a3f694cb40261b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.371112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1077/2146] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:28 2022] DELETE /identity/v3/users/53a8aad1e7d34b7c89a3f694cb40261b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:28.646703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:28.657914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996924a3-5608-4f54-b9c6-2cfc45cf0d75 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:28.756238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:28.756907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.757188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.757453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] PATH_INFO: `/v3/projects/afd6766c1cf2407f90e9ac61eb022ca0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.761154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd6766c1cf2407f90e9ac61eb022ca0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:28.763095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:28.815786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd6766c1cf2407f90e9ac61eb022ca0', 'request_id': 'req-75a733f0-26c6-43e6-9d60-3f86418341d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.821579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd6766c1cf2407f90e9ac61eb022ca0', 'request_id': 'req-75a733f0-26c6-43e6-9d60-3f86418341d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.829056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd6766c1cf2407f90e9ac61eb022ca0', 'request_id': 'req-75a733f0-26c6-43e6-9d60-3f86418341d4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.841530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] The token cache is being invalidate because project afd6766c1cf2407f90e9ac61eb022ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:28.841812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.842442 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75a733f0-26c6-43e6-9d60-3f86418341d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:28.843918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1070/2147] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:28 2022] DELETE /identity/v3/projects/afd6766c1cf2407f90e9ac61eb022ca0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:28.849923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.850212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.850489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.871542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:28.872850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:28.933774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1078/2148] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:28.943689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:28.943970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:28.944242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:28.960682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:28.966791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:28.968053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:28.978983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1071/2149] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:28.983250 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:28.993830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b8cf7-3d56-4505-b046-1479d04e2325 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.001558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.003278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.003278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.003649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.004391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:29.004725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.006684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.021256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1079/2150] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:29.025775 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.050569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3dcf0-7477-4d62-bbf1-595f59a8c9a2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.058169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.058910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.059254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.059836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.060472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.062969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.111933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1072/2151] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:29 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:29.113739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.127321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180dbf-cda9-4d62-b9fc-70618eea27df admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.198893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.199609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.200023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.200303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.200996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.203066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.234828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1080/2152] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:29 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:29.235541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.242163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b3789-8e72-4404-9564-dad3c17c3cf6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.247670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.248278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.248607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.248926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.249572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.251969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.261984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1073/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:29.266103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.272461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:29.276541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a750-dba9-49c5-b9b5-27942a7417a5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.282384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.283175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.283510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.283956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.284617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.286249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff9821-6590-47a4-8f81-a9be36275696 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.296923 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1081/2154] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:29.301804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.311576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47418e75-cd86-4c32-97d6-e2495d46d854 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.316791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.317429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.317701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.317968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] PATH_INFO: `/v3/projects/a120e63621f04a3b9b2dd0df7f745b40/users/8ce022e19b6d44329c1208e6546433bc/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.331995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a120e63621f04a3b9b2dd0df7f745b40, user_id=8ce022e19b6d44329c1208e6546433bc, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.334663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.347387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1074/2155] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:29 2022] PUT /identity/v3/projects/a120e63621f04a3b9b2dd0df7f745b40/users/8ce022e19b6d44329c1208e6546433bc/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:29.352598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.352983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.353325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.372436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:29.373724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:29.434734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1082/2156] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:29.445910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.447806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:29.506801 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99df8-fbd8-42b5-94fb-6c8fba7a03f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:29.511057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:29.511712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.511922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.512184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.522857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:29.524712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf198-4e6a-487e-ac47-b8d2655dbc10 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:29.535498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1075/2157] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:30.211341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:30.213328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:30.227500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366273d4-d0a8-40e9-a266-37c1bfb9724d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:30.232109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:30.232781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:30.233065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:30.233338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] PATH_INFO: `/v3/users/521b2af01c014ae1988daa3cf2e80e83` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:30.234461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] RBAC: Authorizing `identity:delete_user(user_id=521b2af01c014ae1988daa3cf2e80e83)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:30.236546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:30.294063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521b2af01c014ae1988daa3cf2e80e83'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:30.305701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521b2af01c014ae1988daa3cf2e80e83'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:30.306358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521b2af01c014ae1988daa3cf2e80e83'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:30.307477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521b2af01c014ae1988daa3cf2e80e83'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:30.314566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521b2af01c014ae1988daa3cf2e80e83'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:30.337497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1083/2158] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:30 2022] DELETE /identity/v3/users/521b2af01c014ae1988daa3cf2e80e83 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:30.341894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:30.342710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:30.342992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:30.363673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:30.364926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:30.450729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1076/2159] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:30.462802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:30.464253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:30.537076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe1af-e259-4cf1-950c-5bf09cf0525d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:30.543196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:30.543815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:30.544628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:30.544852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:30.555193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:30.556621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:30.569244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1084/2160] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:30.962437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:30.963914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:30.997229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5624e-df62-403b-8553-ccc3a0cee5db None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:31.004149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:31.005151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:31.005494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:31.005866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] PATH_INFO: `/v3/users/54b4875977e540a1b878ee14387c9290` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:31.007113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b4875977e540a1b878ee14387c9290)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:31.009349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:31.114008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:31.138267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b4875977e540a1b878ee14387c9290'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.161347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b4875977e540a1b878ee14387c9290'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.181862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b4875977e540a1b878ee14387c9290'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.183751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b4875977e540a1b878ee14387c9290'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.184293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f541c408-057b-4143-b99b-21a0c29a8a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b4875977e540a1b878ee14387c9290'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.189749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:31.191653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:31.227832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1077/2161] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:30 2022] DELETE /identity/v3/users/54b4875977e540a1b878ee14387c9290 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:31.229455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:31.229572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfa3c-a26f-4801-9c1d-0195c66e0f22 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:31.230013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:31.230199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:31.244217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:31.258046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:31.259431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:31.324519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:31.325378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:31.325735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:31.326073 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] PATH_INFO: `/v3/projects/4e345ed2c1e74d4da0b7fb89d490b75f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:31.327382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e345ed2c1e74d4da0b7fb89d490b75f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:31.329737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:31.345810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1078/2162] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:31.358723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:31.360768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:31.447388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e345ed2c1e74d4da0b7fb89d490b75f', 'request_id': 'req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.455409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e345ed2c1e74d4da0b7fb89d490b75f', 'request_id': 'req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.472176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e71b6-48ae-4e34-a6b3-a93656606451 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:31.480787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e345ed2c1e74d4da0b7fb89d490b75f', 'request_id': 'req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.496786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] The token cache is being invalidate because project 4e345ed2c1e74d4da0b7fb89d490b75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:31.497169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.497952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:31.499660 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1085/2163] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:31 2022] DELETE /identity/v3/projects/4e345ed2c1e74d4da0b7fb89d490b75f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:31.574006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:31.574689 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:31.575012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:31.575337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:31.577569 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:31.634109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:31.710939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:31.713190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:31.727116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1079/2164] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:23:32.015133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:32.017183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:32.031404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d456b9e-1e92-4b07-87be-d7ed5e65eb01 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:32.038670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:32.039317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.040372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.040758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] PATH_INFO: `/v3/projects/fd07b95ec5b14410b4427838699b1423` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.042361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd07b95ec5b14410b4427838699b1423)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:32.044667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:32.108961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd07b95ec5b14410b4427838699b1423', 'request_id': 'req-7c589310-072b-4be5-82f4-58ebfdd348f5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.116952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd07b95ec5b14410b4427838699b1423', 'request_id': 'req-7c589310-072b-4be5-82f4-58ebfdd348f5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.126318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd07b95ec5b14410b4427838699b1423', 'request_id': 'req-7c589310-072b-4be5-82f4-58ebfdd348f5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.141158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] The token cache is being invalidate because project fd07b95ec5b14410b4427838699b1423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:32.141506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.142222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.146549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1086/2165] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:32 2022] DELETE /identity/v3/projects/fd07b95ec5b14410b4427838699b1423 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:32.148085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:32.160559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c30271-3ec1-41bc-bdf8-d7ba88023788 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:32.237353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:32.238376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.238777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.239192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] PATH_INFO: `/v3/users/d6d78c2bd87548348dcb5a3614d48cd5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.240403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d78c2bd87548348dcb5a3614d48cd5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:32.242436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:32.302927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d78c2bd87548348dcb5a3614d48cd5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.314369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d78c2bd87548348dcb5a3614d48cd5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.323545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d78c2bd87548348dcb5a3614d48cd5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.324330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d78c2bd87548348dcb5a3614d48cd5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.324972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fe66e3c5-5386-49b3-9eb2-abb01414df90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d78c2bd87548348dcb5a3614d48cd5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.346691 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1080/2166] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:32 2022] DELETE /identity/v3/users/d6d78c2bd87548348dcb5a3614d48cd5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:32.684691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:32.687303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:32.733068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c589310-072b-4be5-82f4-58ebfdd348f5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:32.758664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:32.823636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:32.823636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.825253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.825253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] PATH_INFO: `/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.827440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe64f41c50504ec9acd0314a2dfc98b9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:32.830127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:32.956195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe64f41c50504ec9acd0314a2dfc98b9', 'request_id': 'req-fdb6e606-f274-4742-aa15-0ec4504ba36b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.967063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe64f41c50504ec9acd0314a2dfc98b9', 'request_id': 'req-fdb6e606-f274-4742-aa15-0ec4504ba36b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:32.987085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe64f41c50504ec9acd0314a2dfc98b9', 'request_id': 'req-fdb6e606-f274-4742-aa15-0ec4504ba36b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:33.032560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] The token cache is being invalidate because project fe64f41c50504ec9acd0314a2dfc98b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:33.032938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:33.035764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdb6e606-f274-4742-aa15-0ec4504ba36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:33.041486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1087/2167] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:32 2022] DELETE /identity/v3/projects/fe64f41c50504ec9acd0314a2dfc98b9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:33.049476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.049972 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.050407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.079723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:33.089349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:33.155621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:33.179525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1081/2168] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:33.190378 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.191117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.191610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.242283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:33.246064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:33.270668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1088/2169] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:33.274793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.285780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6308b5-9bf3-4181-b75e-6fc2feb12351 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.291151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.292839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.292937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.293130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.293788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:33.294088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.295951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.313023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1082/2170] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:33.313968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.331260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa407-76b6-4fd9-88a3-1ab7826151e4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.336571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.337595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.337909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.338150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.338771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.340834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.383475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1089/2171] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:33 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:33.387560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.399905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7433196-ee82-4930-bed4-2be5af502e0d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.524291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.525544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.526440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.528053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.529437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.533926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.574868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1083/2172] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:33 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:33.576059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.593260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3837-df31-4985-89e3-f0f85ec1c38a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.601794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.602882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.603367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.603856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.605308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.607401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.629878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1090/2173] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:33.630500 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.649482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798730-cd85-4ba7-a3f8-05a9798aa307 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.657361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.658482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.658892 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.659208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.660199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.662063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f403f-c37a-4a02-a14d-28068c2c4343 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.681662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1084/2174] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:33.685709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.697193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6735-4ac6-4203-85c9-72f5db320934 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.701987 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.702749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.703216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.704141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] PATH_INFO: `/v3/projects/81f366187b174a56bf0f451afb62972a/users/434753052fdd46aaa499bb5f3b840ca1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.721696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f366187b174a56bf0f451afb62972a, user_id=434753052fdd46aaa499bb5f3b840ca1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.724670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.745492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1091/2175] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:33 2022] PUT /identity/v3/projects/81f366187b174a56bf0f451afb62972a/users/434753052fdd46aaa499bb5f3b840ca1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:33.753132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.753439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.753853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.788685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] MFA Rules not processed for user `434753052fdd46aaa499bb5f3b840ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:33.790120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:33.867403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1085/2176] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:33.881895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:33.884795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:33.948125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:33.953683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af3f60-f441-44f0-811d-fd4425415a87 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:33.959861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:33.960631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:33.961319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:33.962773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:33.974606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:33.976035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7588f5-c070-454d-902f-e4375381c89d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:33.992888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1092/2177] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:35.130433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:35.149638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4acab-c357-4c11-8b0a-32d9ac5690c5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:35.156108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:35.157037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:35.159660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:35.160431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:35.164762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:35.238438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:35.270119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:35.271915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ced7-805a-4e50-be36-64584c07d094 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:35.294799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1086/2178] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:35.395159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:35.395724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:35.395724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:35.463498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] MFA Rules not processed for user `439c49c0d87a4764b0c7c71d40c23071`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:35.465054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:35.576076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1093/2179] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:35.827581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a047f6d-38c9-4409-9a4d-bf50a63a6577 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:35.828285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a047f6d-38c9-4409-9a4d-bf50a63a6577 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:35.829427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a047f6d-38c9-4409-9a4d-bf50a63a6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:35.893195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9a047f6d-38c9-4409-9a4d-bf50a63a6577 None None] MFA Rules not processed for user `8ce022e19b6d44329c1208e6546433bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:35.894437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a047f6d-38c9-4409-9a4d-bf50a63a6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:36.035244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1087/2180] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:36.262163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:36.263903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:36.384502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e14fc6-245e-4294-ab74-e29b0abeb9fc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:36.390213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:36.391716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:36.392018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:36.392292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:36.401617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:36.403273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fafaab-5116-4605-9c42-15ff3ed8076e service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:36.432548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1094/2181] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:37.964849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bab0-c931-4fc8-8a8f-0ab494ee54f5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:37.965305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bab0-c931-4fc8-8a8f-0ab494ee54f5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:37.965607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bab0-c931-4fc8-8a8f-0ab494ee54f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:37.990425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b903bab0-c931-4fc8-8a8f-0ab494ee54f5 None None] MFA Rules not processed for user `8ce022e19b6d44329c1208e6546433bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:37.991802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b903bab0-c931-4fc8-8a8f-0ab494ee54f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:37.999072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1088/2182] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:46.409658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=63 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:47.985104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=47 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:56.921564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:56.922103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:56.922202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:56.924318 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1095/2183] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:56.979336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:56.979336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:56.979336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:57.004519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] MFA Rules not processed for user `3925e5acb5fb4f0dbaf5549b19119161`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:57.006295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:57.091077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1089/2184] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:23:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:57.113056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:57.114934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:57.132010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:57.133921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:57.149607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f97a-483c-488c-9f4d-8266d00ada44 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:57.158961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:57.159586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:57.159866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:57.160138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:57.169333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:57.170935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:57.182745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1090/2185] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:57.230801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b695c95-62a1-4081-8795-29b9d50b1fa3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:57.237388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:57.238099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:57.238477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:57.238865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] PATH_INFO: `/v3/users/7c39e9d660d14971b2fdd362482bf20e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:57.240100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c39e9d660d14971b2fdd362482bf20e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:57.242191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:57.297372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c39e9d660d14971b2fdd362482bf20e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.306146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c39e9d660d14971b2fdd362482bf20e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.306857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c39e9d660d14971b2fdd362482bf20e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.307561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c39e9d660d14971b2fdd362482bf20e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.316277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c39e9d660d14971b2fdd362482bf20e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.338054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1096/2186] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:57 2022] DELETE /identity/v3/users/7c39e9d660d14971b2fdd362482bf20e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:57.800274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:57.823417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba85cc-6442-4574-8b3f-b2f4aca57013 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:57.898907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:57.899544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:57.899822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:57.900096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] PATH_INFO: `/v3/projects/68fc6347e0f44f5eaa10e8b420e4cf87` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:57.901237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fc6347e0f44f5eaa10e8b420e4cf87)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:57.903181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:57.951742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fc6347e0f44f5eaa10e8b420e4cf87', 'request_id': 'req-5e74967e-c6c3-483c-8604-5662935db22d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.957621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fc6347e0f44f5eaa10e8b420e4cf87', 'request_id': 'req-5e74967e-c6c3-483c-8604-5662935db22d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.965046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fc6347e0f44f5eaa10e8b420e4cf87', 'request_id': 'req-5e74967e-c6c3-483c-8604-5662935db22d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.976751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] The token cache is being invalidate because project 68fc6347e0f44f5eaa10e8b420e4cf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:57.977037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.977672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:57.979203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1091/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:57 2022] DELETE /identity/v3/projects/68fc6347e0f44f5eaa10e8b420e4cf87 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:57.983155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:57.984737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:57.998765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e147-06dd-4a3c-a0f3-5cb154bd0492 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:58.066933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:58.067583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.067861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.068132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] PATH_INFO: `/v3/users/8a991955d910483eacb525118db28f07` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.069335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a991955d910483eacb525118db28f07)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:58.071280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:58.098013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:58.133157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a991955d910483eacb525118db28f07'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.142626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a991955d910483eacb525118db28f07'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.143670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a991955d910483eacb525118db28f07'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.144334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a991955d910483eacb525118db28f07'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.155023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fae24ac-f0c9-442b-ad74-68a49a62afcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a991955d910483eacb525118db28f07'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.192027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1097/2188] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:23:57 2022] DELETE /identity/v3/users/8a991955d910483eacb525118db28f07 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:58.613433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:58.614927 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.644544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74967e-c6c3-483c-8604-5662935db22d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:58.658053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:58.710495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:58.711438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.711877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.712145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] PATH_INFO: `/v3/projects/d328f6c0e60249c184b1f3c386fc4891` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.713278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d328f6c0e60249c184b1f3c386fc4891)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:58.715191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:58.773570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd328f6c0e60249c184b1f3c386fc4891', 'request_id': 'req-f6a9850e-5e2c-452f-a617-33604be61788'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.779954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd328f6c0e60249c184b1f3c386fc4891', 'request_id': 'req-f6a9850e-5e2c-452f-a617-33604be61788'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.789446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd328f6c0e60249c184b1f3c386fc4891', 'request_id': 'req-f6a9850e-5e2c-452f-a617-33604be61788'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.813074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] The token cache is being invalidate because project d328f6c0e60249c184b1f3c386fc4891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:23:58.813947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.814837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f6a9850e-5e2c-452f-a617-33604be61788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:23:58.816556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1092/2189] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:23:58 2022] DELETE /identity/v3/projects/d328f6c0e60249c184b1f3c386fc4891 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:58.821652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.822075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.822354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.843654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:58.844926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.907854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1098/2190] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:58.916462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.916740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.917310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.937447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:58.939564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.947696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1093/2191] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:58.952051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:58.963133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c3a6-63ac-49a1-9cae-b8d70a0d04f4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:58.967727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:58.968342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.968615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.968995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.969848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:23:58.970162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:58.971607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:58.984343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1099/2192] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:58.989295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.006109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb68c8-720c-43f0-a5ba-712486f0c4f9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.011055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.011686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.011965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.012526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.013213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.015167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.048719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1094/2193] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:23:58 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:23:59.051531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.061870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df52f7-0535-4e76-bda3-e460e5ff58a0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.121143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.121806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.122106 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.122358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.123001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.124943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.148533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1100/2194] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:23:59 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:59.152915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.166491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7664ce-375d-4dcb-a86d-7ee87e0ac9be admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.183236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.184016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.184330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.185252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.186219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.189855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.225620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1095/2195] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:59.229371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.241569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629542-70cf-43ff-ac2f-7c5428f59313 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.248888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.249590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.249934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.250240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.251575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.253314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce9a6-9c06-437f-aa28-0b9306d6fbb7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.270391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1101/2196] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:23:59.271599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.284424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3574-8beb-480e-85ff-f826c532e290 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.291308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.292282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.292953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.293457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] PATH_INFO: `/v3/projects/d85b9660d7a14331b66b361b8edbfe79/users/85d1d362997d4ca396d8bab0d488dc71/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.327597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b9660d7a14331b66b361b8edbfe79, user_id=85d1d362997d4ca396d8bab0d488dc71, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.338191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.358300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1096/2197] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:23:59 2022] PUT /identity/v3/projects/d85b9660d7a14331b66b361b8edbfe79/users/85d1d362997d4ca396d8bab0d488dc71/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:23:59.370239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4b2f-a074-4820-86c9-28bfbdd698bb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.370239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4b2f-a074-4820-86c9-28bfbdd698bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.370239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4b2f-a074-4820-86c9-28bfbdd698bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.379533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:59.407245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-68ce4b2f-a074-4820-86c9-28bfbdd698bb None None] MFA Rules not processed for user `85d1d362997d4ca396d8bab0d488dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:59.409093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68ce4b2f-a074-4820-86c9-28bfbdd698bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:59.540028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1102/2198] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:23:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:59.551073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:59.553694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:59.607452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:59.625704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a335ee3-07e6-446d-8dea-278efda2fb97 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:59.632825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:59.637639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:59.638038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:59.638510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:59.655177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:59.657049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:59.686181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1097/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:02.789340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:02.789960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:02.789960 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:02.810666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:02.811868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:02.868557 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1103/2200] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:02.908781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:02.910217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:02.984483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef71eb-61cd-4615-81ba-446d55e26b9b service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:02.989738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:02.990356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:02.990641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:02.990913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:02.999460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:03.001142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286d16-c7a9-496e-b144-e55a2fea2f11 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:03.009141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1098/2201] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:24:10.423408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:10.498501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769030-3573-4d61-8206-fda9f0c0594c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:10.504344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:10.504952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:10.505238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:10.505513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] PATH_INFO: `/v3/users/85d1d362997d4ca396d8bab0d488dc71` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:10.506653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d1d362997d4ca396d8bab0d488dc71)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:10.509157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:10.554463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:10.559755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d1d362997d4ca396d8bab0d488dc71'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:10.568519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d1d362997d4ca396d8bab0d488dc71'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:10.569150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d1d362997d4ca396d8bab0d488dc71'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:10.569763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d1d362997d4ca396d8bab0d488dc71'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:10.576529 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d1d362997d4ca396d8bab0d488dc71'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:10.593274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1104/2202] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:24:10 2022] DELETE /identity/v3/users/85d1d362997d4ca396d8bab0d488dc71 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:10.597848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:10.598383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:10.598487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:10.618906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:10.620149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:10.679056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1099/2203] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:10.690285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:10.691935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:10.765084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e16b91-9f4f-406c-8336-1caf9aa4d14d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:10.770328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:10.770976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:10.771439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:10.771578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:10.782927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:10.784383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:10.795547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1105/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:11.302570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:11.304221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:11.320116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d56b7-f45b-4c23-83ea-b0530fc8340b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:11.327153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:11.329846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:11.329846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:11.329846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] PATH_INFO: `/v3/projects/d85b9660d7a14331b66b361b8edbfe79` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:11.331861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85b9660d7a14331b66b361b8edbfe79)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:11.337326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:11.436045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85b9660d7a14331b66b361b8edbfe79', 'request_id': 'req-25c96c89-1c9c-43ae-a71e-812595217398'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:11.456286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85b9660d7a14331b66b361b8edbfe79', 'request_id': 'req-25c96c89-1c9c-43ae-a71e-812595217398'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:11.472578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85b9660d7a14331b66b361b8edbfe79', 'request_id': 'req-25c96c89-1c9c-43ae-a71e-812595217398'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:11.476364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:11.490465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] The token cache is being invalidate because project d85b9660d7a14331b66b361b8edbfe79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:24:11.491803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:11.505174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-25c96c89-1c9c-43ae-a71e-812595217398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:11.508121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1100/2205] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:24:11 2022] DELETE /identity/v3/projects/d85b9660d7a14331b66b361b8edbfe79 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:15.039906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:15.042092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:15.055880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceb13a-2178-4020-99bd-89e872fb3644 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:15.124207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:15.124944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:15.125328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:15.125608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] PATH_INFO: `/v3/users/434753052fdd46aaa499bb5f3b840ca1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:15.126785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434753052fdd46aaa499bb5f3b840ca1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:15.128883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:15.187582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434753052fdd46aaa499bb5f3b840ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.200958 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434753052fdd46aaa499bb5f3b840ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.201712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434753052fdd46aaa499bb5f3b840ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.202355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434753052fdd46aaa499bb5f3b840ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.211632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434753052fdd46aaa499bb5f3b840ca1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.215787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:15.250188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1106/2206] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:24:15 2022] DELETE /identity/v3/users/434753052fdd46aaa499bb5f3b840ca1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:24:15.251776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:15.252302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:15.252490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:15.277250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:15.278498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:15.395697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1101/2207] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:15.402412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:15.404166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:15.480326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704df6-5c06-4427-8a28-3c47f0396f21 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:15.487823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:15.488431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:15.490716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:15.490716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:15.499636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:15.501387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03258f-9604-490b-8efe-0beff515ef26 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:15.512247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1107/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:15.865786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:15.867598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:15.880628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d020f9c-93cd-4c72-81f2-c99cac4bfcdd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:15.885799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:15.886439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:15.886714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:15.886982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] PATH_INFO: `/v3/projects/81f366187b174a56bf0f451afb62972a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:15.888094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f366187b174a56bf0f451afb62972a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:15.890070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:15.969025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f366187b174a56bf0f451afb62972a', 'request_id': 'req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.974760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f366187b174a56bf0f451afb62972a', 'request_id': 'req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.985144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f366187b174a56bf0f451afb62972a', 'request_id': 'req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.996888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] The token cache is being invalidate because project 81f366187b174a56bf0f451afb62972a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:24:15.997176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.997820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8e739ad1-d6f4-4679-87ff-ccb3ef5f1a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:15.999303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1102/2209] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:24:15 2022] DELETE /identity/v3/projects/81f366187b174a56bf0f451afb62972a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:19.521751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:19.522372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:19.522372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:19.544747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] MFA Rules not processed for user `c7d5c3d673104612abaa4661edd37401`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:19.546288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:19.615929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1108/2210] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:21.276229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:21.276725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:21.276833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:21.297620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:21.298814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:21.354258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1103/2211] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:24:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:21.366648 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:21.368096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:21.458480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700419ca-c790-4515-ae24-21ab6ebc0ceb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:21.463489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:21.464234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:21.464519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:21.464851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:21.481571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:21.483662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:21.500055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1109/2212] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:24:23.471958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:23.473672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:23.507917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:23.549375 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f9385-0afb-42f5-9d43-7218bcb1c5c4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:23.554095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:23.554726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:23.555007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:23.555280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] PATH_INFO: `/v3/users/439c49c0d87a4764b0c7c71d40c23071` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:23.556403 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439c49c0d87a4764b0c7c71d40c23071)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:23.558469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:23.605279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439c49c0d87a4764b0c7c71d40c23071'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.613615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439c49c0d87a4764b0c7c71d40c23071'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.620661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439c49c0d87a4764b0c7c71d40c23071'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.621337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439c49c0d87a4764b0c7c71d40c23071'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.621916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5bee19a4-1ef6-42f0-bfc8-8ab869bbdf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439c49c0d87a4764b0c7c71d40c23071'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.639081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1104/2213] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:24:23 2022] DELETE /identity/v3/users/439c49c0d87a4764b0c7c71d40c23071 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:23.817121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:23.838870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3f36-1ac0-448d-af18-4f28785adf87 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:23.855031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:23.902045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:23.902683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:23.902965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:23.903239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] PATH_INFO: `/v3/projects/45a45368ca844789af71be7ebfa8f86b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:23.904359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a45368ca844789af71be7ebfa8f86b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:23.907108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:23.955220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a45368ca844789af71be7ebfa8f86b', 'request_id': 'req-4314797a-155c-4bbd-9772-32e25167ad64'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.960694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a45368ca844789af71be7ebfa8f86b', 'request_id': 'req-4314797a-155c-4bbd-9772-32e25167ad64'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.969853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a45368ca844789af71be7ebfa8f86b', 'request_id': 'req-4314797a-155c-4bbd-9772-32e25167ad64'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.981245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] The token cache is being invalidate because project 45a45368ca844789af71be7ebfa8f86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:24:23.981533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.982150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4314797a-155c-4bbd-9772-32e25167ad64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:23.983622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1110/2214] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:24:23 2022] DELETE /identity/v3/projects/45a45368ca844789af71be7ebfa8f86b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:23.988616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:23.988935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:23.989203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.008174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:24.009448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:24.066456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1105/2215] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:24.074343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.074665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.074942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.095576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:24.096841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:24.105063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1111/2216] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:24.109197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.118895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649a1ee-d19e-45cb-9ca5-5e71f02648e9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.123381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.123967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.124244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.124514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.125184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:24:24.125483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.127079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.138262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1106/2217] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:24:24.143066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.152117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6be56a-687b-497a-b499-b725d3a4127b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.157520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.158098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.158370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.158636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.159257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.161166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.187264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1112/2218] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:24:24 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:24.195974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.207272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3282167-47fe-446b-ab90-90fdb543e08b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.241643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:24.272242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.272821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.273105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.273374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.273991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.275952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.296714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1107/2219] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:24:24 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:24.300857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.311072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c68e1-4b38-4a55-829d-f82b73cc0019 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.316329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.316963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.317260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.317516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.318156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.319728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.330060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1113/2220] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:24.333853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.344180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bfd33-42a8-4d0c-b4ab-4a0f85b572e0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.349057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.349762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.350042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.350313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.350952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.352875 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2df1-b34a-4e48-b99c-b7ce93870b03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.363153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1108/2221] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:24.366968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.377420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82d604-840d-4ca4-8e97-1b9d1c2c97b8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.382071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.382719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.383002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.383280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] PATH_INFO: `/v3/projects/009708c86c7048de8fcb5d570887451c/users/de85072032b34f27b50811884bcfc21c/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.398160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009708c86c7048de8fcb5d570887451c, user_id=de85072032b34f27b50811884bcfc21c, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.400842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.413565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1114/2222] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:24:24 2022] PUT /identity/v3/projects/009708c86c7048de8fcb5d570887451c/users/de85072032b34f27b50811884bcfc21c/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:24.424406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.424731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.425007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.452471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] MFA Rules not processed for user `de85072032b34f27b50811884bcfc21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:24.454548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:24.522861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1109/2223] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:24.534310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:24.536011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:24.583109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:24.595723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b2cdd-f47b-4d9d-80da-63dcd56b60d8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:24.599439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:24.600034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:24.600307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:24.600572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:24.609023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:24.610862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38649-14c7-4254-b35c-3bde87af1d49 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:24.619491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1115/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:27.157617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:27.222482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f0bd-a472-411f-a379-1cc3da42ec6e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:27.227130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:27.227750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.228020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.228286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] PATH_INFO: `/v3/users/de85072032b34f27b50811884bcfc21c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.229480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=de85072032b34f27b50811884bcfc21c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:27.231388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:27.271668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:27.277981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de85072032b34f27b50811884bcfc21c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.286047 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de85072032b34f27b50811884bcfc21c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.292828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de85072032b34f27b50811884bcfc21c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.293441 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de85072032b34f27b50811884bcfc21c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.294066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de85072032b34f27b50811884bcfc21c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.311700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1110/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:24:27 2022] DELETE /identity/v3/users/de85072032b34f27b50811884bcfc21c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:24:27.316424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.316917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.317011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.337495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:27.338741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.399463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1116/2226] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:27.409830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:27.411298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.477399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a39e-7e1f-4d2f-9075-cc9e1ea30cdb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:27.481040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:27.481642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.481917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.482179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.491587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:27.493050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7169fe-3ee7-4049-af20-100b286d97fc service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:27.502774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1111/2227] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:27.766165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:27.767731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.780062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8782c-b6d5-408a-a4f8-9bbf517a0d14 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:27.785466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:27.786094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.786371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.786727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] PATH_INFO: `/v3/projects/009708c86c7048de8fcb5d570887451c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.787845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009708c86c7048de8fcb5d570887451c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:27.789804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:27.840681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009708c86c7048de8fcb5d570887451c', 'request_id': 'req-66c1d267-72e3-4b88-b82e-5d087193e4f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.847242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009708c86c7048de8fcb5d570887451c', 'request_id': 'req-66c1d267-72e3-4b88-b82e-5d087193e4f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.855312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009708c86c7048de8fcb5d570887451c', 'request_id': 'req-66c1d267-72e3-4b88-b82e-5d087193e4f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.866897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] The token cache is being invalidate because project 009708c86c7048de8fcb5d570887451c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:24:27.867190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.867868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-66c1d267-72e3-4b88-b82e-5d087193e4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:27.869395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1117/2228] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:24:27 2022] DELETE /identity/v3/projects/009708c86c7048de8fcb5d570887451c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:27.874297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.874580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.874860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.894284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:27.895505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.957577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1112/2229] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:27.965280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.965569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.965843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.986750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:27.987959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.996906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1118/2230] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:28.001260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.011001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4873e-558f-49f2-a110-004fea9c2947 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.016214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.016861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.017143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.017410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.018058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:24:28.018360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.019951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.032522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1113/2231] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:24:28.036894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.046236 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b68f6-5b8f-4821-8f07-3d42d64e3370 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.051005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.051606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.051885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.052173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.053010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.054696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.084218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1119/2232] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:24:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:28.088400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.098476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf528ec5-62bf-4fae-bd21-79e0c417b14a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.143072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:28.155750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.156380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.156693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.156952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.157582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.159506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.179685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1114/2233] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:24:28 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:28.183826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.194669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ab6f-7479-4871-b0d1-40c819f95d32 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.199288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.199877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.200157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.200423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.201087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.202670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.213889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1120/2234] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:28.217475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.227755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b9dc-03e2-4005-9594-d5e73b2d544a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.232418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.233038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.233315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.233583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.234270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.236020 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340b409-7e80-4899-b73d-5dd1042c93f9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.246556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1115/2235] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:28.251300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.261380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971884-9ff2-4431-b0f0-f98e7ea49a00 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.266505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.267168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.267444 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.267739 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] PATH_INFO: `/v3/projects/4e93306467bc4022973d431bd7bb144f/users/865ca27c0ed445568171e9812d4091fe/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.282096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e93306467bc4022973d431bd7bb144f, user_id=865ca27c0ed445568171e9812d4091fe, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.284777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.298011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1121/2236] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:24:28 2022] PUT /identity/v3/projects/4e93306467bc4022973d431bd7bb144f/users/865ca27c0ed445568171e9812d4091fe/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:24:28.308169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1d1a5-af86-4771-9279-47951a7e0258 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.308479 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1d1a5-af86-4771-9279-47951a7e0258 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.308793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1d1a5-af86-4771-9279-47951a7e0258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.336525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8ab1d1a5-af86-4771-9279-47951a7e0258 None None] MFA Rules not processed for user `865ca27c0ed445568171e9812d4091fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:28.337767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8ab1d1a5-af86-4771-9279-47951a7e0258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:28.400852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1116/2237] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:28.412523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:28.414278 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:28.425031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:28.495594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc6b0-64b8-43fd-b2b0-f8d47f02425a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:28.502001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:28.502657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:28.502893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:28.503164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:28.512508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:28.513898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:28.525054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1122/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:38.397918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:38.520387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=32 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:52.699524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adadc6-5056-4772-8c18-22fef56a71ab None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:52.700032 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adadc6-5056-4772-8c18-22fef56a71ab None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:52.700137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adadc6-5056-4772-8c18-22fef56a71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:52.719100 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-14adadc6-5056-4772-8c18-22fef56a71ab None None] MFA Rules not processed for user `e536559b9c084a6bafb9d2ce8b493c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:52.720306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-14adadc6-5056-4772-8c18-22fef56a71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:52.774906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1117/2239] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:58.479723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:58.545792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053bef-d11f-4dff-bb91-d47a1f568df6 service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:58.550441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:58.551074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.551352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.551621 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] PATH_INFO: `/v3/users/865ca27c0ed445568171e9812d4091fe` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.552785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865ca27c0ed445568171e9812d4091fe)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:58.554930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:58.605105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865ca27c0ed445568171e9812d4091fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:58.613315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865ca27c0ed445568171e9812d4091fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:58.614134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865ca27c0ed445568171e9812d4091fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:58.614738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865ca27c0ed445568171e9812d4091fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:58.622129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865ca27c0ed445568171e9812d4091fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:58.653766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1123/2240] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:24:58 2022] DELETE /identity/v3/users/865ca27c0ed445568171e9812d4091fe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:58.658130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.658600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.658695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.677704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:58.678885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:58.737858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1118/2241] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:58.746916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:58.748327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:58.805122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5cb3d-88d1-41d3-84a4-a6c48821abb6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:58.808782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:58.809372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.809645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.809911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.819393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:58.820841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f67db-20f0-47f8-a541-5ec14810df30 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:58.829916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1124/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:24:59.110061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.111570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.127055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417046-22d7-48a4-bb5f-0f39f1f1c1b1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.132486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.133175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.133454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.133824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] PATH_INFO: `/v3/projects/4e93306467bc4022973d431bd7bb144f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.134958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e93306467bc4022973d431bd7bb144f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.136904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.184003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e93306467bc4022973d431bd7bb144f', 'request_id': 'req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:59.189427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e93306467bc4022973d431bd7bb144f', 'request_id': 'req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:59.197444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e93306467bc4022973d431bd7bb144f', 'request_id': 'req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:59.208438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] The token cache is being invalidate because project 4e93306467bc4022973d431bd7bb144f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:24:59.208755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:59.209387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bdce4be-a0b7-47aa-8c4a-020cac8c3170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:24:59.210896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1119/2243] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:24:59 2022] DELETE /identity/v3/projects/4e93306467bc4022973d431bd7bb144f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:24:59.215818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.216253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.216755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.243500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:59.244619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.261926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:59.305894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1125/2244] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:59.313773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.314058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.314357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.335578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:59.336809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.344554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1120/2245] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:59.348766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.358468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f027a-9b0b-4167-ad2b-aa6390bc8051 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.363533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.364116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.364390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.364682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.365390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:24:59.365684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.367262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.379279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1126/2246] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:24:59.383495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.392613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff1e15-20c5-4721-b24d-d5ec978dcdf4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.397463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.398056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.398328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.398595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.399206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.401143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.422640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:59.430264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1121/2247] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:24:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:59.434823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.445720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a60e2-d506-42e8-a70e-b63dab332fd9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.503147 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.503763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.503981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.504249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.504906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.507124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.526920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1127/2248] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:24:59 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:24:59.531225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.542114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a934c3-e290-4025-8ed7-f55615947c5d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.546651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.547241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.547516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.547783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.548414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.550976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.561308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1122/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:59.565211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.575421 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e266-f5ec-4899-a96e-d538cb72dbda admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.580094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.580706 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.581113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.581525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.582432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.584045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdb9e-e13c-41ed-8c18-fb0aa741dd45 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.594554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1128/2250] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:24:59.599216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.609390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48944c-56a6-4259-ba64-35d179ded4cb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.615005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.615669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.615939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.616204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] PATH_INFO: `/v3/projects/cad306a125cd4d3fbfe548798137ffee/users/f98f663720574804973a9e168d7a6a8e/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.630884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad306a125cd4d3fbfe548798137ffee, user_id=f98f663720574804973a9e168d7a6a8e, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.633711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.646525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1123/2251] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:24:59 2022] PUT /identity/v3/projects/cad306a125cd4d3fbfe548798137ffee/users/f98f663720574804973a9e168d7a6a8e/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:24:59.651458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22371-3cf4-4bea-9651-2c5c51e8df16 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.651745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22371-3cf4-4bea-9651-2c5c51e8df16 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.652033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22371-3cf4-4bea-9651-2c5c51e8df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.672423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-67e22371-3cf4-4bea-9651-2c5c51e8df16 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:59.673666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-67e22371-3cf4-4bea-9651-2c5c51e8df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.742776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1129/2252] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:59.751999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.754450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.821224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750ab-b7a6-4e64-abce-49494d384851 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.824931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.825546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.825821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.826087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.835995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.837475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.847595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1124/2253] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:04.713906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.714486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.714486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.746625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] MFA Rules not processed for user `f98f663720574804973a9e168d7a6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:04.747867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.767408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:04.824313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1130/2254] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:04.829278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.841424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04a6-5353-4faf-8505-cacf07925a16 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.849103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.849961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.850407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.851130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.853404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.855601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.893831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1125/2255] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:25:04.898221 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.923618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93efad5-289b-4276-8266-c00a37ee814d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.021109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.021871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.022228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.022501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.023138 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.025829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.052889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1131/2256] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.055006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.072415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966d22-3667-45f7-8583-5e1d37185165 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.078005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.078568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.078850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.079124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.079922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.082349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.094511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1126/2257] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.099231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.112283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73bbf9-bf94-47e8-8fad-3367ad44762e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.129669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.130525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.130815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.131091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] PATH_INFO: `/v3/projects/a7063467315842ee84be55ff85eafb84/users/6b624c418baa4de6b34c2db9a75751d1/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.162455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7063467315842ee84be55ff85eafb84, user_id=6b624c418baa4de6b34c2db9a75751d1, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.166166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.187413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1132/2258] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/a7063467315842ee84be55ff85eafb84/users/6b624c418baa4de6b34c2db9a75751d1/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:05.191793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.205287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4592a1d-407b-466d-ade0-f2537a3d9b87 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.273444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.274056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.274329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.274597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.275238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.276873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39772f-b23b-4f03-9b81-7fff3619781f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.287656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1127/2259] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.291738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.303471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6687-6663-4c21-bb9c-1714e9ce3aa1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.308083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.308800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.309072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.309347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] PATH_INFO: `/v3/projects/a7063467315842ee84be55ff85eafb84/users/6b624c418baa4de6b34c2db9a75751d1/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.311270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7063467315842ee84be55ff85eafb84, user_id=6b624c418baa4de6b34c2db9a75751d1, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.313955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.325465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1133/2260] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/a7063467315842ee84be55ff85eafb84/users/6b624c418baa4de6b34c2db9a75751d1/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:10.949011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb0bb-a05c-4cd7-9b0d-067ab951fcb5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.949613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb0bb-a05c-4cd7-9b0d-067ab951fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.949613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb0bb-a05c-4cd7-9b0d-067ab951fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.982459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c8efb0bb-a05c-4cd7-9b0d-067ab951fcb5 None None] MFA Rules not processed for user `6b624c418baa4de6b34c2db9a75751d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:10.983656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c8efb0bb-a05c-4cd7-9b0d-067ab951fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:11.034968 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:11.098812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1128/2261] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:25:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:11.113442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:11.115429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:11.210249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67fe5-ab25-47bb-a0d6-9bd9a1913c80 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:11.229502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:11.230225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.230515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.230788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.239605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:11.314775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:11.316979 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258e6bf-27a0-41cd-b577-fbf73719dffb service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:11.327298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1134/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:12.585308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:12.585786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:12.585885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:12.608790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] MFA Rules not processed for user `f98f663720574804973a9e168d7a6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:12.610181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:12.617716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1129/2263] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:25:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:20.311447 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:20.311980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:20.312074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:20.333462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:20.334748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:20.393139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1135/2264] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:20.416153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:20.417653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:20.495573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e58f6-1b6b-462c-b7e9-64e899728836 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:20.500457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:20.501092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:20.501399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:20.501671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:20.509710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:20.511294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d94722-c793-4195-bd4a-0333a62f8b54 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:20.519910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1130/2265] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:30.385837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=49 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:30.515998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=55 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:35.230487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:35.231976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:35.308771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3764f57-93b1-4785-b847-3c27ff067b25 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:35.310851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:35.311481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:35.311752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:35.312016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:35.313847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:35.325742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:35.327302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4520-8e50-496c-954f-993351b58ab7 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:35.336996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1136/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:37.048434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.049113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.049113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.050993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1131/2267] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:37.059479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1465a6-dbf7-45e8-a28e-8135a2d8399e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.059981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1465a6-dbf7-45e8-a28e-8135a2d8399e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.060081 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1465a6-dbf7-45e8-a28e-8135a2d8399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.084333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dd1465a6-dbf7-45e8-a28e-8135a2d8399e None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:37.085937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd1465a6-dbf7-45e8-a28e-8135a2d8399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.099350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1137/2268] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:37.114547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:37.116792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.192963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782ae4-7c09-4e56-919e-ab7e202f2797 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:37.197824 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:37.198742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.199176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.200127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.216911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:37.219522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37657f4-b1de-4844-8628-9a073f6488e2 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:37.233394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1132/2269] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:37.303587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6427-3d6d-4d89-9d1c-d5237e691a93 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.303869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6427-3d6d-4d89-9d1c-d5237e691a93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.304140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6427-3d6d-4d89-9d1c-d5237e691a93 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.305519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1138/2270] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:37.310496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf20d-9d9c-4542-abec-b5d925910de4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.310782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf20d-9d9c-4542-abec-b5d925910de4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.311053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf20d-9d9c-4542-abec-b5d925910de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.333394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-489cf20d-9d9c-4542-abec-b5d925910de4 None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:37.334744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-489cf20d-9d9c-4542-abec-b5d925910de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.400832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1133/2271] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:37.412420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6427-3d6d-4d89-9d1c-d5237e691a93 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:37.434143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6427-3d6d-4d89-9d1c-d5237e691a93 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:37.443741 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:37.444334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.444611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.445358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.454946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:37.461516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec9fc3-70cf-45ed-bddb-66a95ad9f91d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:37.472234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1139/2272] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:37.603573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.603851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.604116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.605852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1134/2273] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:37.613468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19682b9c-9ae7-43e5-8de1-48b9ccdad944 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.613779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19682b9c-9ae7-43e5-8de1-48b9ccdad944 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.614079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19682b9c-9ae7-43e5-8de1-48b9ccdad944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.634746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-19682b9c-9ae7-43e5-8de1-48b9ccdad944 None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:37.636019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19682b9c-9ae7-43e5-8de1-48b9ccdad944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.645944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1140/2274] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:37.656843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:37.659915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.676683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bfbc8-fd12-4fc5-b665-6bcfca1c7abf None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:37.679979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:37.680692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.681027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.681361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.693338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:37.694843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:37.706435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1135/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:43.263303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.263781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.263875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.283043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:43.284360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:43.291451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1141/2276] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:43.304230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:43.315859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b12bb-a0a3-4ea3-acd1-b77c5dd73010 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:43.320869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.321498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.321742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.322010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.330126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.331725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac696eb-1789-490f-b615-2a840e06e7a4 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.340528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1136/2277] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:53.278033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=47 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:53.337180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=61 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:06.132069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.141453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9bb5e-868f-4dc7-aa5d-db322a5129be None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.145744 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.146345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.146623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.146895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.157345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.159101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.169379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1142/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:09.679177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373fc9-994d-48ce-a406-4cd100f5661b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:09.680072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373fc9-994d-48ce-a406-4cd100f5661b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:09.680527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373fc9-994d-48ce-a406-4cd100f5661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:09.702496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-33373fc9-994d-48ce-a406-4cd100f5661b None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:09.704077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33373fc9-994d-48ce-a406-4cd100f5661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:09.713942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1137/2279] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:26:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:09.727661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:09.741032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a1d5-d207-409a-bf07-b6e2cc148934 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:09.746400 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:09.747079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:09.747427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:09.747764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:09.757579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:09.759399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb300-b17a-45bd-9cff-a3849f173e43 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:09.776799 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1143/2280] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:26:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:26:19.697335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:19.765313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=12 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:43.804003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.804955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.805228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.824636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] MFA Rules not processed for user `c7d5c3d673104612abaa4661edd37401`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:43.825946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:43.899106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1138/2281] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:53.891265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=25 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:55.863547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:55.864054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:55.864054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:55.883343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] MFA Rules not processed for user `e536559b9c084a6bafb9d2ce8b493c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:55.885175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:55.938753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1144/2282] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:26:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:03.467862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.477573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb38207-afba-4446-91df-d54eea0eca7b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.481157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.481739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.482009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.482274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.483977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:03.497322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.498727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.510058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1139/2283] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:04.684093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.693593 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be7c6f-19f5-42bd-85d7-b295fc302960 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.697789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.698408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.698684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.698952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.700638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:04.714416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.715823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e50a7-a4eb-4226-b670-c987d94ed529 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.726409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1145/2284] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:13.504596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:14.721835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=31 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:20.200329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.201839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:20.215673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32febcf-91b3-44ea-9551-ca203c888c1b service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.221206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.221800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.222079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.222347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.223998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:20.282726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.284322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.294076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1140/2285] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:25.681748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:25.682267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:25.682458 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:25.701416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] MFA Rules not processed for user `bcf8360980c64096ab7187a38895612e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:25.702605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:25.709364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1146/2286] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:27:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:26.009339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:26.019192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3914-e2b7-4aaf-9c6a-956a8b1cd0af service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:26.022808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:26.023397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:26.023670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:26.023935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:26.025647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:26.034813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:26.036228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:26.044236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1141/2287] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:26.613876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:26.626542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39e9ee-2b3d-4aa3-9af5-387fa9a4bad4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:26.631345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:26.631943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:26.632218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:26.632488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:26.634254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:26.646397 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:26.647952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:26.658973 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1147/2288] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:29.212191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:29.221527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05576f34-2084-4db1-b123-62331b36fd40 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:29.225054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:29.225638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:29.225910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:29.226175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:29.228109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:29.238318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:29.239728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:29.247767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1142/2289] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:36.654781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=9 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:39.244008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=40 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:48.949379 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:48.950824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:49.008169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273d16-7f01-431b-b097-d1a096512181 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:49.012611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:49.013234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:49.013510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:49.013782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:49.015504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:49.026569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:49.028034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:49.037091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1148/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:56.645990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:56.660248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a79ff-9299-4388-b974-6de0e0da3702 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:56.666052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:56.666874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:56.667313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:56.668346 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:56.670568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:56.684373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:56.686007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:56.697435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1143/2291] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:59.032887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=26 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:06.692733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:08.814243 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:08.823420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cec29-af61-4539-a738-f71b2fb150a4 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:08.827247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:08.827826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:08.828098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:08.828365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:08.830070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:08.895730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:08.897256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:08.907858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1149/2292] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:12.530781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:12.532246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.548380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476f3f-66b1-4e75-9a5a-9651d36b05bb service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:12.552871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:12.553492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.553764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.554030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] PATH_INFO: `/v3/users/c7d5c3d673104612abaa4661edd37401` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.555154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d5c3d673104612abaa4661edd37401)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:12.557097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:12.609082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d5c3d673104612abaa4661edd37401'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.616538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d5c3d673104612abaa4661edd37401'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.623564 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d5c3d673104612abaa4661edd37401'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.624200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d5c3d673104612abaa4661edd37401'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.624828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6e097b73-32fe-4087-820d-383cd965fd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d5c3d673104612abaa4661edd37401'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.642191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1144/2293] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:12 2022] DELETE /identity/v3/users/c7d5c3d673104612abaa4661edd37401 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:12.813696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:12.823570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314121f8-ab21-4d9a-8bd2-3feaa87a85aa service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:12.883491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:12.884121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.884402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.884705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] PATH_INFO: `/v3/projects/fefb9a3f45414993a77653ca20b38ab4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.885820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefb9a3f45414993a77653ca20b38ab4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:12.888317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:12.935034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefb9a3f45414993a77653ca20b38ab4', 'request_id': 'req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.940483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefb9a3f45414993a77653ca20b38ab4', 'request_id': 'req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.947981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefb9a3f45414993a77653ca20b38ab4', 'request_id': 'req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.959607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] The token cache is being invalidate because project fefb9a3f45414993a77653ca20b38ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:12.959892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.960520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7918b1a6-ab6a-48ec-a5db-9ed8c74f42ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:12.962032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1150/2294] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:12 2022] DELETE /identity/v3/projects/fefb9a3f45414993a77653ca20b38ab4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:12.967535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.967847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.968125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.987522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:12.988674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.046388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1145/2295] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:13.054066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.054366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.054632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.075364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:13.076569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.084260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1151/2296] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:13.088393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.098146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f361cd2-187f-4a55-84eb-37bff02efc6c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.102719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.103314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.103857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.104129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.104812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:13.105172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.107179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.118828 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1146/2297] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:13.123756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.132908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e4476-9743-4c9d-94b2-ceaa17948326 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.138372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.138952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.139226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.139490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.140096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.141991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.159310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:13.172286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1152/2298] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:13 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:13.176520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.187109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb81c4-fb9e-417e-85e0-6f230587f0fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.249126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.249753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.250034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.250301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.250928 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.252990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.262760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:13.277792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1147/2299] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:13 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:13.281920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.292369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe7b1a-5d34-4871-8204-0bb351935a15 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.297915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.298534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.298817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.299089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.299766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.301490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.312180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1153/2300] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:13.316234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.328052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10551de-6be0-4015-8358-88ea028278a4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.332822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.333420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.333696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.333965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.334596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.336214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f0012-9cc0-4310-bddd-23d71b32d0db admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.346665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1148/2301] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:13.351011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.361807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2dcb-c000-4bae-a8be-94a2d41078c3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.366443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.367089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.367366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.367638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] PATH_INFO: `/v3/projects/64c848e0926a43adaeb42c397275b17c/users/e43d87c5d354444e831966af877346fd/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.382628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c848e0926a43adaeb42c397275b17c, user_id=e43d87c5d354444e831966af877346fd, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.385341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.398340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1154/2302] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:13 2022] PUT /identity/v3/projects/64c848e0926a43adaeb42c397275b17c/users/e43d87c5d354444e831966af877346fd/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:13.403401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297cca8-bdbc-4a98-98c7-257aa4eb542b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.403697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297cca8-bdbc-4a98-98c7-257aa4eb542b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.403962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297cca8-bdbc-4a98-98c7-257aa4eb542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.423811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3297cca8-bdbc-4a98-98c7-257aa4eb542b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:13.425067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3297cca8-bdbc-4a98-98c7-257aa4eb542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.484767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1149/2303] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:13.494360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.496767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.553427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c46fc0-0f39-4278-b8d1-ecf70a25e34d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.557031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.557636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.557909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.558773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.567617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.569066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.578356 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1155/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:28:14.201238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.201797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.201797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.233895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] MFA Rules not processed for user `e43d87c5d354444e831966af877346fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:14.235142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:14.303690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1150/2305] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:14.308366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.318631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3398-a550-4507-8b66-5378113561aa service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.323256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.324367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.324692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.324971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.325606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.327563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.357058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1156/2306] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:14 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:14.360847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.380597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b8d4-50bf-4b5d-8af4-34e23bedbaa9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.447049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.447709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.447983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.448252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.449506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.451425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.468867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:14.476363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1151/2307] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:14 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:14.481232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.492115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce33ce-d93e-47a9-a72a-79e04c9b1304 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.497803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.498461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.498742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.499015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.499664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.501401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.515561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1157/2308] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:14.519913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.530979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb296d0b-a27a-4ed8-9e3f-fb6fad83033f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.535534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.536184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.536461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.536764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] PATH_INFO: `/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d/users/16a4bd072916405cac9125422416763f/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.551922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c08016fd22c44dc83f11aa8e0adfb0d, user_id=16a4bd072916405cac9125422416763f, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.554627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.567401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1152/2309] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:14 2022] PUT /identity/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d/users/16a4bd072916405cac9125422416763f/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:14.571595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.581721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f764-875d-43ce-a060-3c7f262f40d8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.638443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.639046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.639326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.639595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.640225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.641850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58046c-a758-4df3-80d5-9c7909a1e5fb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.651373 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1158/2310] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:14.656081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.666440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60640-ebc1-4d4a-909b-d26b83642e7b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.671810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.672454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.672764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.673036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] PATH_INFO: `/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d/users/16a4bd072916405cac9125422416763f/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.674916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c08016fd22c44dc83f11aa8e0adfb0d, user_id=16a4bd072916405cac9125422416763f, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.677599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.687840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1153/2311] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:14 2022] PUT /identity/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d/users/16a4bd072916405cac9125422416763f/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:15.303935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:15.304223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:15.304503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:15.334425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] MFA Rules not processed for user `16a4bd072916405cac9125422416763f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:15.335653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:15.349606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:15.407671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1159/2312] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:16.441662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:16.506543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074c1a-fde7-42ff-9b9f-855f9f3707ce admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:16.511001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:16.511723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:16.512002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:16.512272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] PATH_INFO: `/v3/users/e43d87c5d354444e831966af877346fd` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:16.513448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43d87c5d354444e831966af877346fd)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:16.515360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:16.565230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43d87c5d354444e831966af877346fd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.572332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43d87c5d354444e831966af877346fd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.579266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43d87c5d354444e831966af877346fd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.579908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43d87c5d354444e831966af877346fd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.580558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43d87c5d354444e831966af877346fd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.597693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1154/2313] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:16 2022] DELETE /identity/v3/users/e43d87c5d354444e831966af877346fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:16.773375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:16.785021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2496-e556-4a58-b012-f02a5865dcaf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:16.843440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:16.844070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:16.844349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:16.844620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] PATH_INFO: `/v3/projects/64c848e0926a43adaeb42c397275b17c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:16.845760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c848e0926a43adaeb42c397275b17c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:16.847666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:16.893583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c848e0926a43adaeb42c397275b17c', 'request_id': 'req-f78f470b-fb30-4a67-84e6-f543e77ce305'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.899256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c848e0926a43adaeb42c397275b17c', 'request_id': 'req-f78f470b-fb30-4a67-84e6-f543e77ce305'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.907131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c848e0926a43adaeb42c397275b17c', 'request_id': 'req-f78f470b-fb30-4a67-84e6-f543e77ce305'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.918832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] The token cache is being invalidate because project 64c848e0926a43adaeb42c397275b17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:16.919116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.919746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:16.921261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1160/2314] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:16 2022] DELETE /identity/v3/projects/64c848e0926a43adaeb42c397275b17c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:16.925173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:16.926576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:16.939532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc003-c302-4376-892a-441eaae93dcf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:16.977683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:16.998600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:16.999246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:16.999508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:16.999776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] PATH_INFO: `/v3/users/16a4bd072916405cac9125422416763f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.000925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a4bd072916405cac9125422416763f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.002849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.049221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a4bd072916405cac9125422416763f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.056573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a4bd072916405cac9125422416763f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.063791 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a4bd072916405cac9125422416763f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.064405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a4bd072916405cac9125422416763f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.064985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-38a22658-c43b-4904-810a-c02065f28632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a4bd072916405cac9125422416763f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.081794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1155/2315] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:16 2022] DELETE /identity/v3/users/16a4bd072916405cac9125422416763f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:17.256411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.257851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:17.276002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f470b-fb30-4a67-84e6-f543e77ce305 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.320704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:17.339277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.340684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.340964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.341234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] PATH_INFO: `/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.342340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c08016fd22c44dc83f11aa8e0adfb0d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.344234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.391013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c08016fd22c44dc83f11aa8e0adfb0d', 'request_id': 'req-01e27d4b-6383-4274-a669-06dff9be02e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.396742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c08016fd22c44dc83f11aa8e0adfb0d', 'request_id': 'req-01e27d4b-6383-4274-a669-06dff9be02e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.404548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c08016fd22c44dc83f11aa8e0adfb0d', 'request_id': 'req-01e27d4b-6383-4274-a669-06dff9be02e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.415491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] The token cache is being invalidate because project 1c08016fd22c44dc83f11aa8e0adfb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:17.415780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.416423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01e27d4b-6383-4274-a669-06dff9be02e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:17.418244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1161/2316] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:17 2022] DELETE /identity/v3/projects/1c08016fd22c44dc83f11aa8e0adfb0d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:28:17.422983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.423264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.423531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.442739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:17.443938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:17.503557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1156/2317] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:17.511857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.512306 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.512585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.532562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:17.533811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:17.541680 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1162/2318] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:17.546163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.555756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1209c-2319-4d50-90f3-c2ba4b923eb7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.561230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.561823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.562101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.562370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.563010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:17.563310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.565092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.577431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1157/2319] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:17.581796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.591006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac642bc-1580-4fd3-ba27-492a2d3321d1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.595700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.596291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.596570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.596872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.597491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.599387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.626703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1163/2320] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:17.630902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.641517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ebc5-8178-4053-8536-9609e0057b77 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.685145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:17.699659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.700386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.700614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.700912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.701537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.703471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.723478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1158/2321] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:17.727704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.738140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec63a1-6916-46f2-870d-608c66517d41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.742684 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.743269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.743541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.743803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.744428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.746554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.756338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1164/2322] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:17.760358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.771132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db923e6-e176-4064-8a3e-268e360c3e41 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.775752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.776350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.776628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.777093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.777729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.779327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa485b6-eb82-4191-96fd-9f7f588d360b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.789648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1159/2323] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:17.793693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:17.803994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb99674-f720-4717-b5f7-9b5c63e81bda admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:17.809186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:17.809881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.810159 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.810452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] PATH_INFO: `/v3/projects/6e2eeeae69cc4a7288d6cc01e149797d/users/2fb8d69ce62d462daf10005f4dee4ef1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.825732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2eeeae69cc4a7288d6cc01e149797d, user_id=2fb8d69ce62d462daf10005f4dee4ef1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:17.828450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:17.841820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1165/2324] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:17 2022] PUT /identity/v3/projects/6e2eeeae69cc4a7288d6cc01e149797d/users/2fb8d69ce62d462daf10005f4dee4ef1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:17.852042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:17.852323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:17.852592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:17.880457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] MFA Rules not processed for user `2fb8d69ce62d462daf10005f4dee4ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:17.881690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:17.945396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1160/2325] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:17.950675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.013384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff3c0-4039-4807-b7ae-b0cf934878ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.018132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.018723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.018998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.019266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.019872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.021925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.036028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:18.050554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1166/2326] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:17 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:18.054716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.065963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dc51-1d6e-4b04-b8ef-9bfe378b9a40 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.122342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.122950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.123229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.123501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.124130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.126085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.146702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1161/2327] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:18 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:18.150814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.161971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac93cd-8d62-4a58-b6bf-3aac46fd249a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.166607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.167205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.167517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.167920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.168543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.170163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.180756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1167/2328] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:18.184878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.194779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b5c-6d68-48b0-8998-745678c349d6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.200167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.200816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.201095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.201367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] PATH_INFO: `/v3/projects/73041a21863c459a82ff5214e6ca59b1/users/73ba4ab29a184f54935aa81b67612708/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.216293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73041a21863c459a82ff5214e6ca59b1, user_id=73ba4ab29a184f54935aa81b67612708, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.218971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.232265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1162/2329] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:18 2022] PUT /identity/v3/projects/73041a21863c459a82ff5214e6ca59b1/users/73ba4ab29a184f54935aa81b67612708/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:18.236429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.247059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b252f-6847-46be-a527-14374ff40df7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.303603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.304204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.304481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.304778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.305405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.307008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44616191-bc06-4dc5-9b68-8da10e4244e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.318025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1168/2330] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:18.322241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.333436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bf69-d8cc-4364-96a4-154a0b37ca0e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.338090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.338744 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.339018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.339349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] PATH_INFO: `/v3/projects/73041a21863c459a82ff5214e6ca59b1/users/73ba4ab29a184f54935aa81b67612708/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.341233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=73041a21863c459a82ff5214e6ca59b1, user_id=73ba4ab29a184f54935aa81b67612708, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.343863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.354335 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1163/2331] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:18 2022] PUT /identity/v3/projects/73041a21863c459a82ff5214e6ca59b1/users/73ba4ab29a184f54935aa81b67612708/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:18.365171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.365454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.365725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.394074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] MFA Rules not processed for user `73ba4ab29a184f54935aa81b67612708`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:18.395202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:18.463104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1169/2332] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:18.474356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:18.476278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:18.486481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:18.535069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104e92-e8d0-4a2a-aa9b-ee8fb1a050ce admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:18.538710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:18.539307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:18.539581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:18.539847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:18.548602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:18.550052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8146d9-1928-4ef2-9cb6-3cafa5de15c8 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:18.559979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1164/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:18.972496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:19.034795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69574165-fc0d-4b53-9ade-fe32bd634491 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:19.039260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:19.039884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:19.040164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:19.040435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] PATH_INFO: `/v3/users/2fb8d69ce62d462daf10005f4dee4ef1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:19.041574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb8d69ce62d462daf10005f4dee4ef1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:19.043916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:19.048506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:19.092686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb8d69ce62d462daf10005f4dee4ef1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.099993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb8d69ce62d462daf10005f4dee4ef1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.100658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb8d69ce62d462daf10005f4dee4ef1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.101322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb8d69ce62d462daf10005f4dee4ef1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.109501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb8d69ce62d462daf10005f4dee4ef1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.126689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1170/2334] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:18 2022] DELETE /identity/v3/users/2fb8d69ce62d462daf10005f4dee4ef1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:19.131262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:19.131552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:19.131829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:19.150146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:19.151350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:19.208459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1165/2335] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:19.219185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:19.220627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:19.277853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba213805-7458-4655-b27a-c538afad3c57 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:19.281531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:19.282133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:19.282414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:19.282688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:19.291764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:19.293834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:19.303242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1171/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:28:19.568167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:19.569678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:19.583675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836716d-1988-406d-9d89-cc3dbbdbc879 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:19.588234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:19.588975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:19.589233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:19.590323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] PATH_INFO: `/v3/projects/6e2eeeae69cc4a7288d6cc01e149797d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:19.591415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2eeeae69cc4a7288d6cc01e149797d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:19.593421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:19.642985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2eeeae69cc4a7288d6cc01e149797d', 'request_id': 'req-7e950c72-5341-4040-ab53-bd32c40256e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.648664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2eeeae69cc4a7288d6cc01e149797d', 'request_id': 'req-7e950c72-5341-4040-ab53-bd32c40256e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.657078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2eeeae69cc4a7288d6cc01e149797d', 'request_id': 'req-7e950c72-5341-4040-ab53-bd32c40256e5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.668222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] The token cache is being invalidate because project 6e2eeeae69cc4a7288d6cc01e149797d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:19.668501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.669151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.670632 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1166/2337] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:19 2022] DELETE /identity/v3/projects/6e2eeeae69cc4a7288d6cc01e149797d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:19.674618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:19.684363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4c47-b3a8-415e-b948-f5cb331c14d9 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:19.741123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:19.741666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:19.741942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:19.742211 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] PATH_INFO: `/v3/users/73ba4ab29a184f54935aa81b67612708` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:19.743314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ba4ab29a184f54935aa81b67612708)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:19.745252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:19.773823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:19.793197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ba4ab29a184f54935aa81b67612708'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.800160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ba4ab29a184f54935aa81b67612708'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.800822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ba4ab29a184f54935aa81b67612708'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.801429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ba4ab29a184f54935aa81b67612708'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.808837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ddfd985f-645d-42e9-8ebe-41ef697abc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ba4ab29a184f54935aa81b67612708'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:19.826571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1172/2338] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:19 2022] DELETE /identity/v3/users/73ba4ab29a184f54935aa81b67612708 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:20.099621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.101093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:20.115830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950c72-5341-4040-ab53-bd32c40256e5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.146411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:20.175152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.175785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.176063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.176334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] PATH_INFO: `/v3/projects/73041a21863c459a82ff5214e6ca59b1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.177471 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73041a21863c459a82ff5214e6ca59b1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.179390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.226030 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73041a21863c459a82ff5214e6ca59b1', 'request_id': 'req-82622740-34e2-4f26-98a7-deb780b5068a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:20.232655 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73041a21863c459a82ff5214e6ca59b1', 'request_id': 'req-82622740-34e2-4f26-98a7-deb780b5068a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:20.240194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73041a21863c459a82ff5214e6ca59b1', 'request_id': 'req-82622740-34e2-4f26-98a7-deb780b5068a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:20.251634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] The token cache is being invalidate because project 73041a21863c459a82ff5214e6ca59b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:20.251918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:20.252538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-82622740-34e2-4f26-98a7-deb780b5068a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:20.254025 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1167/2339] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:20 2022] DELETE /identity/v3/projects/73041a21863c459a82ff5214e6ca59b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:20.258859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.259327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.259434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.279251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:20.280448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:20.339474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1173/2340] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:20.347322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.347684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.347965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.495119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:20.496362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:20.504225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1168/2341] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:20.508521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.518322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91f1c-c360-4ae0-83c5-23ffaf8c19d4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.522836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.523425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.523703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.523969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.524607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:20.524940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.526524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.538638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1174/2342] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:28:20.543936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.553159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df40c3-02f0-4b31-9680-73f79f1d0998 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.557877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.558666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.558945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.559208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.559820 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.561876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.588315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1169/2343] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:20.593157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.604114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15595-770b-44ed-80eb-9b7ba41b9b96 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.659709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.660302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.660578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.660877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.661597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.663502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.684173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1175/2344] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:20.688171 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.698113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27ed4-7106-4c25-af2d-090a92816502 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.703089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.703716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.703988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.704253 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.704921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.706525 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.717429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1170/2345] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:20.721364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.732487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde48e-90de-4e94-b92c-52dcb26cd749 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.737104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.737693 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.737970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.738238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.738866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.740441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a69ef0-b347-4f51-b5c8-14ddd12629c5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.751193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1176/2346] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:20.755084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.765163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c578-c94f-45e2-b66b-bb0ba4fbde8f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.769707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.770348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.770630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.770902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] PATH_INFO: `/v3/projects/919c2d9b42454c57b7b2334c0d1a4dee/users/6ee03dd89e344324bb0133cc6a32c3f1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.785661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919c2d9b42454c57b7b2334c0d1a4dee, user_id=6ee03dd89e344324bb0133cc6a32c3f1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.788294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.803146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1171/2347] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:20 2022] PUT /identity/v3/projects/919c2d9b42454c57b7b2334c0d1a4dee/users/6ee03dd89e344324bb0133cc6a32c3f1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:20.813764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.814054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.814329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.834393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:20.843096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] MFA Rules not processed for user `6ee03dd89e344324bb0133cc6a32c3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:20.844806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:20.908836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1177/2348] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:20.913437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:20.973990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff8e6-195c-4b09-8860-cbae7678cf13 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:20.978931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:20.979529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:20.979812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:20.980222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:20.980873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:20.982888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:20.987343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:21.012141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1172/2349] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:21.016580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.027829 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9a22-f660-408a-b6b5-8487c140508b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.083357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.084002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.084284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.084556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.085210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.087121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.108512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1178/2350] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:21 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:21.112922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.123300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0043b4-bbc2-40f0-aa85-85f98f2e132a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.127874 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.128464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.128799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.129073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.129709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.131293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.141583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1173/2351] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:21.145403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.155871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d897f64-437a-4bc5-b0f9-12afbe7b5b69 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.160591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.161212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.161492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.161769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.162411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.163995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79acb0-7165-4543-b42b-bd11dda24c42 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.174173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1179/2352] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:21.178325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.188161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148019d-1aa1-4658-a7ef-c2232ccb1d17 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.192728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.193368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.193644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.193911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] PATH_INFO: `/v3/projects/a2f471ece58744a4a9c88e97fa9f9a8f/users/9f8aafeb74f34127a1cbde5c891552ba/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.208950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f471ece58744a4a9c88e97fa9f9a8f, user_id=9f8aafeb74f34127a1cbde5c891552ba, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.211634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.225499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1174/2353] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:21 2022] PUT /identity/v3/projects/a2f471ece58744a4a9c88e97fa9f9a8f/users/9f8aafeb74f34127a1cbde5c891552ba/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:21.237515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.237837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.238170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.266824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] MFA Rules not processed for user `9f8aafeb74f34127a1cbde5c891552ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:21.268020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:21.332160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1180/2354] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:21.336872 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.397757 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa6ee-b4a1-4563-8bc6-72ed171d2ba5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.402343 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.402958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.403233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.403501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.404122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.406054 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.433783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1175/2355] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:21 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:21.438399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.450185 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c10b2-726b-4eda-86e4-37895dfee0d0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.454774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:21.507975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.508572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.508925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.509195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.509804 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.512891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.532945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1181/2356] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:21 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:21.536977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.547236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671868a-576f-4e4a-93d6-d779cdeafee3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.551761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.552353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.552628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.552933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.553567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.555153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.565461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1176/2357] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:21.569366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.579929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54412f6a-df90-4a69-b1d5-76cf40af6d11 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.584553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.585228 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.585508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.585786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] PATH_INFO: `/v3/projects/c94c721e3292434aaa2bab63333ba837/users/fe31ec066b7b4de6ab48effe9613dbc0/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.601690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94c721e3292434aaa2bab63333ba837, user_id=fe31ec066b7b4de6ab48effe9613dbc0, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.604552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.618001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1182/2358] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:21 2022] PUT /identity/v3/projects/c94c721e3292434aaa2bab63333ba837/users/fe31ec066b7b4de6ab48effe9613dbc0/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:21.622822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.632768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85532-cbf4-4cfd-ab29-95c62f24f70d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.691868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.692454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.692752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.693018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.693635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.695214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04e727-d614-4d43-b1ca-133a999644ed admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.704555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1177/2359] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:21.708972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.719079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39944c-c632-432a-ae61-58297b030a4b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.723581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.724224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.724503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.724814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] PATH_INFO: `/v3/projects/c94c721e3292434aaa2bab63333ba837/users/fe31ec066b7b4de6ab48effe9613dbc0/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.726691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94c721e3292434aaa2bab63333ba837, user_id=fe31ec066b7b4de6ab48effe9613dbc0, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.729654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.740033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1183/2360] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:21 2022] PUT /identity/v3/projects/c94c721e3292434aaa2bab63333ba837/users/fe31ec066b7b4de6ab48effe9613dbc0/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:21.750493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.750770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.751075 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.777558 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] MFA Rules not processed for user `fe31ec066b7b4de6ab48effe9613dbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:21.778807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:21.787380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:21.848182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1178/2361] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:21.859440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:21.861230 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:21.918234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3a70-7a7e-472c-8530-85f8f7feba2b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:21.921897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:21.922488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:21.922764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:21.923030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:21.931746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:21.933191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:21.942418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1184/2362] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:22.434531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:22.435908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:22.447782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99c8a1-211a-43bc-aa71-c711612c8a14 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:22.451637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:22.452230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:22.452505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:22.452809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:22.508938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:22.510396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:22.519098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1179/2363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:26.483824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:26.485844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:26.522265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:26.539004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac1a5-7626-4331-a52a-996def417d46 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:26.542912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:26.543777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:26.544056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:26.544332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:26.561982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:26.569780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fba8f-69c9-4142-85d6-c38b20221c6e service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:26.576137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:26.576778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:26.577060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:26.577331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:26.579107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:26.601804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:26.603155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:26.612863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1180/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:28:26.640413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:26.642274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a91fd6-a40b-489c-a064-446e5a290b83 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:26.651692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1185/2365] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:28.735440 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:28.778720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:28.796668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb0dd-48fe-47aa-948e-a2a7b4a8c2ee service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:28.801102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:28.801720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:28.801995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:28.802263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] PATH_INFO: `/v3/users/6ee03dd89e344324bb0133cc6a32c3f1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:28.803365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee03dd89e344324bb0133cc6a32c3f1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:28.805300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:28.850181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee03dd89e344324bb0133cc6a32c3f1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.857792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee03dd89e344324bb0133cc6a32c3f1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.864887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee03dd89e344324bb0133cc6a32c3f1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.865512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee03dd89e344324bb0133cc6a32c3f1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.866097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee03dd89e344324bb0133cc6a32c3f1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.883022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1181/2366] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:28 2022] DELETE /identity/v3/users/6ee03dd89e344324bb0133cc6a32c3f1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:28.888401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:28.888919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:28.889016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:28.908430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:28.909656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:28.968784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1186/2367] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:28.978444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:28.980132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.036816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cbe18-1018-4fc0-99cb-07af5cd10a71 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.040405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.041036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.041317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.041588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.051562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.053034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:29.062439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1182/2368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:29.336456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.337961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.350199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c293cc-9d45-48ab-aadc-f6aa2c7920ac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.355329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.356042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.356389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.356687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] PATH_INFO: `/v3/projects/919c2d9b42454c57b7b2334c0d1a4dee` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.357813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919c2d9b42454c57b7b2334c0d1a4dee)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.359750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:29.413692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919c2d9b42454c57b7b2334c0d1a4dee', 'request_id': 'req-03c9ef93-613f-464e-8e56-1843281589e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.419728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919c2d9b42454c57b7b2334c0d1a4dee', 'request_id': 'req-03c9ef93-613f-464e-8e56-1843281589e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.427679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919c2d9b42454c57b7b2334c0d1a4dee', 'request_id': 'req-03c9ef93-613f-464e-8e56-1843281589e9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.445844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] The token cache is being invalidate because project 919c2d9b42454c57b7b2334c0d1a4dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:29.446130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.446777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.448303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1187/2369] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:29 2022] DELETE /identity/v3/projects/919c2d9b42454c57b7b2334c0d1a4dee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:29.453427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.462954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c947-11cf-4aad-b6e2-dd10533eaa45 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.518499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.519152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.519518 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.519882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] PATH_INFO: `/v3/users/9f8aafeb74f34127a1cbde5c891552ba` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.521031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8aafeb74f34127a1cbde5c891552ba)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.522943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:29.527495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:29.570141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8aafeb74f34127a1cbde5c891552ba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.577070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8aafeb74f34127a1cbde5c891552ba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.583735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8aafeb74f34127a1cbde5c891552ba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.584350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8aafeb74f34127a1cbde5c891552ba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.585019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8aafeb74f34127a1cbde5c891552ba'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.602618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1183/2370] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:29 2022] DELETE /identity/v3/users/9f8aafeb74f34127a1cbde5c891552ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:29.894388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.895947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.913659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ef93-613f-464e-8e56-1843281589e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.935798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:29.974753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.975381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.975657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.975927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] PATH_INFO: `/v3/projects/a2f471ece58744a4a9c88e97fa9f9a8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.977091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f471ece58744a4a9c88e97fa9f9a8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.979270 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.033405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f471ece58744a4a9c88e97fa9f9a8f', 'request_id': 'req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.040386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f471ece58744a4a9c88e97fa9f9a8f', 'request_id': 'req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.053014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f471ece58744a4a9c88e97fa9f9a8f', 'request_id': 'req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.066129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] The token cache is being invalidate because project a2f471ece58744a4a9c88e97fa9f9a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:30.066523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.067145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.068895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1188/2371] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:29 2022] DELETE /identity/v3/projects/a2f471ece58744a4a9c88e97fa9f9a8f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:30.073306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.075780 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.089164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00f4-9c35-4c24-9ae8-2f4571e9e668 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.153412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.154048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.154326 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.154597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] PATH_INFO: `/v3/users/fe31ec066b7b4de6ab48effe9613dbc0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.155778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe31ec066b7b4de6ab48effe9613dbc0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.157747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.210848 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe31ec066b7b4de6ab48effe9613dbc0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.221663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe31ec066b7b4de6ab48effe9613dbc0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.235037 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe31ec066b7b4de6ab48effe9613dbc0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.236094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe31ec066b7b4de6ab48effe9613dbc0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.236812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0873779f-8323-4a87-9b13-56cbebba46e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe31ec066b7b4de6ab48effe9613dbc0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.262299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1184/2372] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:30 2022] DELETE /identity/v3/users/fe31ec066b7b4de6ab48effe9613dbc0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:30.594991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.596518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.624920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59ce9-3c74-4ec3-b7f0-cc1fbf107567 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.708224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.708891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.709165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.709432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] PATH_INFO: `/v3/projects/c94c721e3292434aaa2bab63333ba837` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.710547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94c721e3292434aaa2bab63333ba837)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.712513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.779816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94c721e3292434aaa2bab63333ba837', 'request_id': 'req-8aa15f79-0616-49dd-a9af-02cfbac17789'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.784599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:30.785891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94c721e3292434aaa2bab63333ba837', 'request_id': 'req-8aa15f79-0616-49dd-a9af-02cfbac17789'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.799712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94c721e3292434aaa2bab63333ba837', 'request_id': 'req-8aa15f79-0616-49dd-a9af-02cfbac17789'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.811844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] The token cache is being invalidate because project c94c721e3292434aaa2bab63333ba837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:30.812064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.812828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8aa15f79-0616-49dd-a9af-02cfbac17789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:30.814334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1189/2373] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:30 2022] DELETE /identity/v3/projects/c94c721e3292434aaa2bab63333ba837 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:30.820235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.820522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.820818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.828673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:30.842951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:30.844737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.908035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1185/2374] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:30.918337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.918893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.919009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.941141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:30.942370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.951337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1190/2375] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:30.954907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.965873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81114ed-906e-48bd-9da0-385ac3168690 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.970502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.971109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.971386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.971659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.972303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:30.972602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.974230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.989931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1186/2376] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:30.994415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.004749 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a301b-3312-4c0b-b317-32a018d6c653 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.009657 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.010261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.010539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.010809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.012083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.014092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.042935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1191/2377] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:30 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:31.047146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.057429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0222-8930-49a3-a595-1ad99ec677ec admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.115155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.115843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.116018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.116285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.116942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.118856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.140048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1187/2378] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:31 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:31.144101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.155469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5801-0b62-442b-9f7c-a1db95c20e3a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.160069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.160717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.161025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.161300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.161934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.163519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.174288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1192/2379] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:31.178251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.188155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4d32-12dd-4fef-b419-d24774b8081a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.193140 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.193882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.194013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.194279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.194957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.196511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9bf35-bdb1-4a29-b27a-3c37148c6d8f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.207130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1188/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:31.211213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.221982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1723a0-8bd7-483a-8c7a-7518350fd37b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.226765 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.227441 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.227722 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.227994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] PATH_INFO: `/v3/projects/16490ce2f57940bb91bf16d6cb1c7742/users/16aa72489625404993213894721bbefa/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.243048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16490ce2f57940bb91bf16d6cb1c7742, user_id=16aa72489625404993213894721bbefa, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.246075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.258285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1193/2381] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:31 2022] PUT /identity/v3/projects/16490ce2f57940bb91bf16d6cb1c7742/users/16aa72489625404993213894721bbefa/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:31.270081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569589-0418-4427-8445-c884b34d4616 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.270364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569589-0418-4427-8445-c884b34d4616 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.270636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569589-0418-4427-8445-c884b34d4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.298385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f7569589-0418-4427-8445-c884b34d4616 None None] MFA Rules not processed for user `16aa72489625404993213894721bbefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:31.299580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7569589-0418-4427-8445-c884b34d4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:31.359353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:31.365259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1189/2382] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:31.369763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.431483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4c93-34ea-4d75-af8d-46144b85d284 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.436157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.436795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.437076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.437350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.437984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.439909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.468210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1194/2383] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:31 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:31.472482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7569589-0418-4427-8445-c884b34d4616 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.484008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7569589-0418-4427-8445-c884b34d4616 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.538817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.539418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.539694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.539962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.540582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.543066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.563237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1190/2384] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:31 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:31.567213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.578020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe228b-136f-4186-9588-bdd6bf23b399 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.582618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.583205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.583482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.583752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.584383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.586010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.597802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1195/2385] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:31.602087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.613352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4fa72-d937-44fa-a64d-1e3650dd6596 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.617878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.618522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.618796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.619062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] PATH_INFO: `/v3/projects/a337cc94c53f449e8e97e7361d7d19dd/users/54c36c99f3a44a31bc5cc798c71bacad/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.633288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a337cc94c53f449e8e97e7361d7d19dd, user_id=54c36c99f3a44a31bc5cc798c71bacad, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.636080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.649577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1191/2386] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:31 2022] PUT /identity/v3/projects/a337cc94c53f449e8e97e7361d7d19dd/users/54c36c99f3a44a31bc5cc798c71bacad/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:31.654284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.664187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1c75-72ff-439b-b10d-3ad9d7020ffa admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.715615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:31.726511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.727430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.727994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.728499 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.729865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.732633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72afe26-8b4c-436b-872b-22528110d12f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.744064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1196/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:31.748508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.758817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940f00-f493-42b7-acf0-5e55eced8452 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.764004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.764662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.764949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.765219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] PATH_INFO: `/v3/projects/a337cc94c53f449e8e97e7361d7d19dd/users/54c36c99f3a44a31bc5cc798c71bacad/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.767090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a337cc94c53f449e8e97e7361d7d19dd, user_id=54c36c99f3a44a31bc5cc798c71bacad, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.769734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.779795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1192/2388] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:31 2022] PUT /identity/v3/projects/a337cc94c53f449e8e97e7361d7d19dd/users/54c36c99f3a44a31bc5cc798c71bacad/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:31.790241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.790525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.790821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.818380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] MFA Rules not processed for user `54c36c99f3a44a31bc5cc798c71bacad`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:31.819572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:31.891861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1197/2389] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:31.903446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:31.905270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:31.963855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0e68-e9fa-41b4-be83-db27b3f15d0f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:31.968316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:31.968878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:31.969206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:31.969474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:31.979778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:31.981277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:31.991175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1193/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:32.045501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:32.047152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:32.059468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d18004-4c2e-4ec3-b33d-303d5af1d0c4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:32.063518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:32.064126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:32.064405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:32.064703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:32.126877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:32.128334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f76e8-eb10-4edd-863d-1b9e83c55176 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:32.139038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1198/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:35.454834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:35.508530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:35.521956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d496ca-0541-41c1-96b0-bf12bcebc768 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:35.527383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:35.528019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:35.528295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:35.528563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] PATH_INFO: `/v3/users/16aa72489625404993213894721bbefa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:35.529737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16aa72489625404993213894721bbefa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:35.531911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:35.584817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16aa72489625404993213894721bbefa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:35.594495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16aa72489625404993213894721bbefa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:35.601713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16aa72489625404993213894721bbefa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:35.602395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16aa72489625404993213894721bbefa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:35.603023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16aa72489625404993213894721bbefa'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:35.624110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1194/2392] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:35 2022] DELETE /identity/v3/users/16aa72489625404993213894721bbefa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:35.628673 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:35.629153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:35.629267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:35.649586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:35.650791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:35.724772 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1199/2393] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:35.735997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:35.737085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:35.804409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888c584-e4c2-4a9e-8acd-821b5fe7547a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:35.811376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:35.812009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:35.812353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:35.812747 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:35.824988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:35.828957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:35.843618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1195/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:36.310728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:36.312225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:36.326017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff22ee9-8a7f-4d1b-8d0e-48ceccb6b500 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:36.331794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:36.332614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:36.332932 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:36.333433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] PATH_INFO: `/v3/projects/16490ce2f57940bb91bf16d6cb1c7742` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:36.334342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16490ce2f57940bb91bf16d6cb1c7742)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:36.336259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:36.349193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:36.390382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16490ce2f57940bb91bf16d6cb1c7742', 'request_id': 'req-5520e737-efb8-45f6-ba67-da05c1405222'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.396267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16490ce2f57940bb91bf16d6cb1c7742', 'request_id': 'req-5520e737-efb8-45f6-ba67-da05c1405222'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.403388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16490ce2f57940bb91bf16d6cb1c7742', 'request_id': 'req-5520e737-efb8-45f6-ba67-da05c1405222'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.415264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] The token cache is being invalidate because project 16490ce2f57940bb91bf16d6cb1c7742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:36.415611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.416275 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.422104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1200/2395] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:36 2022] DELETE /identity/v3/projects/16490ce2f57940bb91bf16d6cb1c7742 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:36.422869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:36.434419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7bcf-1063-412b-af9c-2f2fa627ec08 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:36.492628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:36.493486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:36.493836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:36.494179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] PATH_INFO: `/v3/users/54c36c99f3a44a31bc5cc798c71bacad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:36.495984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c36c99f3a44a31bc5cc798c71bacad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:36.498028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:36.516156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:36.554303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c36c99f3a44a31bc5cc798c71bacad'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.562637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c36c99f3a44a31bc5cc798c71bacad'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.569494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c36c99f3a44a31bc5cc798c71bacad'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.570115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c36c99f3a44a31bc5cc798c71bacad'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.570710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eefb8801-5893-43a5-97c2-22da05260dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c36c99f3a44a31bc5cc798c71bacad'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:36.588829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1196/2396] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:36 2022] DELETE /identity/v3/users/54c36c99f3a44a31bc5cc798c71bacad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:28:36.944119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:36.945625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:36.958391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e737-efb8-45f6-ba67-da05c1405222 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.026066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.027255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.027536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.027806 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] PATH_INFO: `/v3/projects/a337cc94c53f449e8e97e7361d7d19dd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.028974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a337cc94c53f449e8e97e7361d7d19dd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.030870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.080226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a337cc94c53f449e8e97e7361d7d19dd', 'request_id': 'req-b5083901-04bf-4644-a048-a49b2a59a3d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.086169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a337cc94c53f449e8e97e7361d7d19dd', 'request_id': 'req-b5083901-04bf-4644-a048-a49b2a59a3d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.094675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a337cc94c53f449e8e97e7361d7d19dd', 'request_id': 'req-b5083901-04bf-4644-a048-a49b2a59a3d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.108129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] The token cache is being invalidate because project a337cc94c53f449e8e97e7361d7d19dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:37.108496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.109329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5083901-04bf-4644-a048-a49b2a59a3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.111055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1201/2397] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:36 2022] DELETE /identity/v3/projects/a337cc94c53f449e8e97e7361d7d19dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:37.117285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.117576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.117849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.139050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:37.140302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:37.201381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1197/2398] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:37.210766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.210766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.210766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.232074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:37.233488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:37.247753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1202/2399] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:37.249127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.258672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193c60-8e1e-4c72-813d-a7b960f8a591 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.263328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.263950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.264223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.264486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.265154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:37.265450 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.267033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.279307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1198/2400] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:37.283168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.293307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc2e83-960c-42a9-9589-4a73a2bf2246 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.298146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.298747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.299025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.299297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.299918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.301911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.326046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:37.333616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1203/2401] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:37.337966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.349012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5901b8-2114-46fd-b1c1-5eb696175571 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.410227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.410940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.411214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.411477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.412108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.416693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.444877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1199/2402] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:37.446367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.457711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f3d3-6cf4-4217-99ef-d3d38b7f6ce8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.462592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.463196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.463484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.463752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.464613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.466229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.476370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1204/2403] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:37.481457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.491816 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045809d-e1e9-40a0-87c5-960c71528ef5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.497080 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.497680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.497951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.498216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.498854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.500481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d254cd-3a06-43f3-b596-6e9ead64fb9a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.506900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:37.516887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1200/2404] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:37.518075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.528717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2179c21-6421-4410-b348-4de9a2f8632a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.533666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.534324 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.534605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.534878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] PATH_INFO: `/v3/projects/fba436af753e415c846b62cfc2ca8a37/users/7fb41a245764430494be55d6657d3cf1/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.551088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba436af753e415c846b62cfc2ca8a37, user_id=7fb41a245764430494be55d6657d3cf1, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.553810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.567848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1205/2405] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:37 2022] PUT /identity/v3/projects/fba436af753e415c846b62cfc2ca8a37/users/7fb41a245764430494be55d6657d3cf1/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:28:37.579139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.579422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.579690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.608737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] MFA Rules not processed for user `7fb41a245764430494be55d6657d3cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:37.609846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:37.678808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1201/2406] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:37.696085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.697840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:37.759431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9a559-1f71-4fde-84cc-e456a941c270 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.763231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.763839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.764125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.764402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.773035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.774502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5a0b-583d-45f6-85e5-f856ed748137 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.784046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1206/2407] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:37.805653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:37.871843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca73b7-d242-4e0b-8fe5-10a4f512ced2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:37.876555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:37.877237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.877516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.877786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] PATH_INFO: `/v3/users/7fb41a245764430494be55d6657d3cf1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.878932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb41a245764430494be55d6657d3cf1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:37.880876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:37.921535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.921838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.922110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.939143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb41a245764430494be55d6657d3cf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.942777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] MFA Rules not processed for user `e536559b9c084a6bafb9d2ce8b493c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:37.944215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:37.948294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb41a245764430494be55d6657d3cf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.955671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb41a245764430494be55d6657d3cf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.956317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb41a245764430494be55d6657d3cf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.956977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d3d13659-f798-4de8-9dfa-b5acfd0c85ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb41a245764430494be55d6657d3cf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:37.974909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1202/2408] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:37 2022] DELETE /identity/v3/users/7fb41a245764430494be55d6657d3cf1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:37.979466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:37.980401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:37.980829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:37.999793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:38.001048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.003793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1207/2409] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:38.005055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:38.067669 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1203/2410] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:38.078492 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.079870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.138083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d299a5b-9e81-4481-9801-1921c9c416d6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:38.164570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:38.192449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:38.192449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.192761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.193026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.203935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:38.205427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:38.216261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1208/2411] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:28:38.365700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.376063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d172-0407-4bcc-bead-78f173f90abb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:38.379781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:38.380451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.380826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.381149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.382996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.394283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:38.395722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be565392-e221-4d93-ad86-435e4302fe0c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:38.404191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1204/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:38.619109 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.621222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.634476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341f0a0-e46d-4dd0-8a78-f1e62bba3216 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:38.640293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:38.641014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.641240 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.641514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] PATH_INFO: `/v3/projects/fba436af753e415c846b62cfc2ca8a37` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.642753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba436af753e415c846b62cfc2ca8a37)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:38.644773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:38.694582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba436af753e415c846b62cfc2ca8a37', 'request_id': 'req-433ef376-b4c7-4b63-acf7-3bc20b933d48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:38.700428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba436af753e415c846b62cfc2ca8a37', 'request_id': 'req-433ef376-b4c7-4b63-acf7-3bc20b933d48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:38.708302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba436af753e415c846b62cfc2ca8a37', 'request_id': 'req-433ef376-b4c7-4b63-acf7-3bc20b933d48'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:38.719872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] The token cache is being invalidate because project fba436af753e415c846b62cfc2ca8a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:38.720207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:38.720880 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-433ef376-b4c7-4b63-acf7-3bc20b933d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:38.722427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1209/2413] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:38 2022] DELETE /identity/v3/projects/fba436af753e415c846b62cfc2ca8a37 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:38.727386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.727861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.727958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.750208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:38.751704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.843157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1205/2414] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:38.851702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.852018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.852293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.873443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:38.874651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:38.883435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1210/2415] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:38.887861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.898098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc212a08-baca-4dd8-aee7-e8d3516fa7c8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:38.903740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:38.904349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.904676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.904965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.905612 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:38.905917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:38.907522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:38.920370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1206/2416] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:38.924577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.934834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544523c-3db5-464f-a626-d8619e2f75df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:38.939650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:38.940274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:38.940570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:38.940872 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:38.941498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:38.943496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:38.976690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1211/2417] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:38 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:38.978565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:38.989977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980651e-8c0e-4ced-854c-b1d84aea57e8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:39.052056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:39.052672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.052975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.053240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.053850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:39.055739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:39.082174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1207/2418] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:38 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:39.083362 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:39.094688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa86-4f1c-4642-9a85-69d8c75922dc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:39.099726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:39.100330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.100608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.100916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.101558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:39.103180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:39.114570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1212/2419] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:39.118487 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:39.128750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55b5d0-8395-4dea-90f8-34ee7ecfc4a1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:39.133570 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:39.134178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.134455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.134731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.135350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:39.137104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22590-5e49-4710-aeba-f633b4e01cad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:39.147679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1208/2420] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:39.152367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:39.162434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e94d0-9d8c-4814-ae06-ba86419329a3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:39.170965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:39.171787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.172062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.172329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] PATH_INFO: `/v3/projects/54608065cc78497480de0534326a4037/users/ef427d367406418a989fbd6f8df0a16b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.189198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54608065cc78497480de0534326a4037, user_id=ef427d367406418a989fbd6f8df0a16b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:39.191937 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:39.210463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1213/2421] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:39 2022] PUT /identity/v3/projects/54608065cc78497480de0534326a4037/users/ef427d367406418a989fbd6f8df0a16b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:39.278662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.278943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.279214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.286204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:39.307567 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] MFA Rules not processed for user `ef427d367406418a989fbd6f8df0a16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:39.308916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:39.372850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1209/2422] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:39.393792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:39.395608 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:39.458358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cacd6-12d3-4b15-ab85-2ad88cc0889d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:39.462015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:39.462620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:39.462896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:39.463163 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:39.468884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:39.474016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:39.475947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:39.486220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1214/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:47.823145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:47.825210 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:47.902498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e3aa6-5f48-4a38-a945-741823357c60 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:47.907832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:47.908457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:47.908832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:47.909099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:47.910777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:47.922756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:47.924321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f82e8-e6fe-4da6-a00a-ceca0bd3751c service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:47.935329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1210/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:49.482158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:53.148187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:53.210111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2b43-a09c-4db5-880b-1f067d26b988 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:53.214644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:53.215263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.216113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.216388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] PATH_INFO: `/v3/users/ef427d367406418a989fbd6f8df0a16b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.217566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef427d367406418a989fbd6f8df0a16b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:53.219478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:53.269536 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef427d367406418a989fbd6f8df0a16b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.277662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef427d367406418a989fbd6f8df0a16b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.279124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef427d367406418a989fbd6f8df0a16b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.279951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef427d367406418a989fbd6f8df0a16b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.287392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef427d367406418a989fbd6f8df0a16b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.305596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1215/2425] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:53 2022] DELETE /identity/v3/users/ef427d367406418a989fbd6f8df0a16b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:53.310236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.311153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.311425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.330480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:53.331673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:53.395079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1211/2426] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:53.402180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:53.404388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:53.468843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b709-14fe-4de6-ac86-71d142de57e7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:53.472439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:53.473069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.473347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.473617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.483148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:53.484568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8501-c0d7-43fd-b2e4-cb1bd57af2fb service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:53.494130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1216/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:53.763805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:53.765263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:53.777138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3dac-fe51-4ab4-88b0-ffce0332e076 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:53.781807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:53.782438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.782715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.783000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] PATH_INFO: `/v3/projects/54608065cc78497480de0534326a4037` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.784108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54608065cc78497480de0534326a4037)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:53.786050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:53.798513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:53.834478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54608065cc78497480de0534326a4037', 'request_id': 'req-95bd785a-b864-4b44-b1e1-b7bb9050dd62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.839983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54608065cc78497480de0534326a4037', 'request_id': 'req-95bd785a-b864-4b44-b1e1-b7bb9050dd62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.847710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54608065cc78497480de0534326a4037', 'request_id': 'req-95bd785a-b864-4b44-b1e1-b7bb9050dd62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.864423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] The token cache is being invalidate because project 54608065cc78497480de0534326a4037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:53.864748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.865393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-95bd785a-b864-4b44-b1e1-b7bb9050dd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:53.866868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1212/2428] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:53 2022] DELETE /identity/v3/projects/54608065cc78497480de0534326a4037 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:53.871763 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.872040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.872310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.891252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:53.892429 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:53.909737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:53.953033 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1217/2429] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:53.960710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:53.961000 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:53.961272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:53.981985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:53.983186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:53.991052 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1213/2430] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:53.995289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.005181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ed979-0541-4955-ba79-4c62832981c3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.009921 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.010515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.010794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.011066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.011707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:54.012010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.013988 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.025506 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1218/2431] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:54.030245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.039285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617258d-7f4b-4bea-8ab4-d689a7192fd4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.044528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.045147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.045424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.045692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.046303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.048240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.075103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1214/2432] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:54 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:54.079267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.089219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167e6e4-c9cd-4556-8ea6-9c57b59a1436 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.145893 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.146484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.146758 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.147024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.147636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.149566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.171902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1219/2433] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:54 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:28:54.176035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.186557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324cf0-0cf9-4233-a0bf-1d88e3b3433d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.191001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.191585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.191856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.192121 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.192776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.194503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.205159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1215/2434] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:54.208953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.219388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a217d-a38b-42fe-b411-33b45fca540b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.223919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.224531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.224837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.225107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.225735 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.227297 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62bde1-0516-4cad-842f-daeeee2340bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.238440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1220/2435] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:54.242596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.253494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759d51c-89a5-44fc-9d8c-cb2c3a68c0e2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.258200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.258837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.259108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.259372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] PATH_INFO: `/v3/projects/8cb89a07cb6542589153e96fbc9a729b/users/a0edaf1628ad412392182acb6752ea0a/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.274754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb89a07cb6542589153e96fbc9a729b, user_id=a0edaf1628ad412392182acb6752ea0a, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.277445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.290970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1216/2436] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:54 2022] PUT /identity/v3/projects/8cb89a07cb6542589153e96fbc9a729b/users/a0edaf1628ad412392182acb6752ea0a/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:54.296951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f86b-7754-4386-9869-47d0a2acc5f0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.297235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f86b-7754-4386-9869-47d0a2acc5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.297505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f86b-7754-4386-9869-47d0a2acc5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.316790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2718f86b-7754-4386-9869-47d0a2acc5f0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:54.317984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2718f86b-7754-4386-9869-47d0a2acc5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:54.378242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1221/2437] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:54.388389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:54.390145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:54.453596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9f84-3d2b-441c-9432-e30ad6948aa9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:54.457179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:54.457773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:54.458045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:54.458310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:54.473961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:54.475443 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:54.486684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1217/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:55.569626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:55.570156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:55.570697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:55.602338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] MFA Rules not processed for user `a0edaf1628ad412392182acb6752ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:55.603556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:55.625037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:55.697288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1222/2439] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:55.705367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:55.707370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:55.778976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:55.804370 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d62c-49bd-42a7-becb-c3729ce7bd8b service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:55.812921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:55.813533 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:55.813799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:55.814120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:55.824217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:55.825581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b48aae-e502-4ea7-9900-e28f38dbb557 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:55.835359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1218/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:56.738076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:56.747827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fdde-09b6-438a-8b8f-b173049f27a5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:56.751420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:56.752015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:56.752293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:56.752563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:56.754323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:56.813736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:56.815174 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:56.824146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1223/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:57.217165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa71b-eb84-4c23-a111-631262b7cdc4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:57.217636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa71b-eb84-4c23-a111-631262b7cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:57.217771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa71b-eb84-4c23-a111-631262b7cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:57.237529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6dffa71b-eb84-4c23-a111-631262b7cdc4 None None] MFA Rules not processed for user `a0edaf1628ad412392182acb6752ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:57.238831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6dffa71b-eb84-4c23-a111-631262b7cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:57.247417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1219/2442] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:01.395481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:01.397481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:01.483882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60535-09eb-4b59-821b-99508865dd52 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:01.489313 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:01.489914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:01.490188 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:01.490455 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:01.492260 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:01.505481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:01.507067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6328e-b8a1-4218-9c34-088f0d692ff9 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:01.519273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1224/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:03.566991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3147f-2f9e-4784-b23e-03102e4660f6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:03.567595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3147f-2f9e-4784-b23e-03102e4660f6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:03.567595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3147f-2f9e-4784-b23e-03102e4660f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:03.586751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-11f3147f-2f9e-4784-b23e-03102e4660f6 None None] MFA Rules not processed for user `8ce022e19b6d44329c1208e6546433bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:03.588006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-11f3147f-2f9e-4784-b23e-03102e4660f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:03.595751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1220/2444] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:29:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:04.689247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbee99-5d20-4fc3-bec4-d2ad2911a635 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:04.689726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbee99-5d20-4fc3-bec4-d2ad2911a635 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:04.689726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbee99-5d20-4fc3-bec4-d2ad2911a635 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:04.691769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1225/2445] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:29:04.698497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658de0-6b91-4f7f-a068-51578cf16638 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:04.699421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658de0-6b91-4f7f-a068-51578cf16638 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:04.700349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658de0-6b91-4f7f-a068-51578cf16638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:04.723660 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9d658de0-6b91-4f7f-a068-51578cf16638 None None] MFA Rules not processed for user `ba51537c644043ae8c31655ad1b6426c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:04.725021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d658de0-6b91-4f7f-a068-51578cf16638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:04.733310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1221/2446] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:29:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:29:04.747114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbee99-5d20-4fc3-bec4-d2ad2911a635 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:04.758827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbee99-5d20-4fc3-bec4-d2ad2911a635 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:04.769888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:04.770510 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:04.770786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:04.771052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:04.780424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:04.782219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:04.807634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1226/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:14.718709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=17 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:14.790253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:25.989923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0779ab-5012-47d9-b170-73440a1e773d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:25.990414 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0779ab-5012-47d9-b170-73440a1e773d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:25.990617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0779ab-5012-47d9-b170-73440a1e773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:26.010152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5b0779ab-5012-47d9-b170-73440a1e773d None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:26.011350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b0779ab-5012-47d9-b170-73440a1e773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:26.069352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1222/2448] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:26.119485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:26.121018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:26.204910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13c66-d6b2-4afb-b11d-79ca4592d0c9 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:26.209983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:26.210601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:26.210879 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:26.211151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:26.219823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:26.221507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:26.230246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1227/2449] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:29:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:29:36.075526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=25 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:36.226544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=32 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:37.140345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d5fe-3637-48e9-859c-e9513b479267 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:37.141434 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d5fe-3637-48e9-859c-e9513b479267 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:37.141566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d5fe-3637-48e9-859c-e9513b479267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:37.161323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5ef1d5fe-3637-48e9-859c-e9513b479267 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:37.162568 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ef1d5fe-3637-48e9-859c-e9513b479267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:37.170287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1223/2450] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:37.208148 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:37.220632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8574-7a99-4034-bb52-37f2ad87f8a1 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:37.226078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:37.226667 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:37.227210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:37.227210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:37.236072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:37.237671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:37.248095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1228/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:41.029195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d640-3d82-4b54-b2ae-3b95ed6778e6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:41.029761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d640-3d82-4b54-b2ae-3b95ed6778e6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:41.029761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d640-3d82-4b54-b2ae-3b95ed6778e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:41.050068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2656d640-3d82-4b54-b2ae-3b95ed6778e6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:41.051200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2656d640-3d82-4b54-b2ae-3b95ed6778e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:41.059002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1224/2452] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:41.103636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:41.105093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:41.121091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81769c45-566d-4a8d-821d-ecc19803148a service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:41.126672 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:41.127262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:41.127562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:41.127831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:41.135846 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:41.137470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5208c1b-5de2-4fe7-b63d-8616368c4046 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:41.146662 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1229/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:44.642460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.642998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.642998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.644585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1225/2454] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:29:44.650198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a598-9b17-4db5-b085-6c16f4e8d62b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.650688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a598-9b17-4db5-b085-6c16f4e8d62b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.650792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a598-9b17-4db5-b085-6c16f4e8d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.671031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a3e8a598-9b17-4db5-b085-6c16f4e8d62b None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:44.673178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3e8a598-9b17-4db5-b085-6c16f4e8d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:44.682359 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1230/2455] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:44.694319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:44.696195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:44.755930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8915-1b2a-446f-bf10-e33ce7d45a39 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:44.759439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:44.760041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.760312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.760576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.771371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:44.772985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fc4d-001f-4af4-8e01-f055e638a0d8 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:44.785329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1226/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:44.917136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f9e4-d2a7-447e-a460-c549f463b8cb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.917512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f9e4-d2a7-447e-a460-c549f463b8cb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.917690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f9e4-d2a7-447e-a460-c549f463b8cb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.919107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1231/2457] 10.222.0.26 () {54 vars in 921 bytes} [Mon Aug 8 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:29:44.925259 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f523d8-ca42-49ec-b495-3dd1fe35518e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.925539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f523d8-ca42-49ec-b495-3dd1fe35518e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.925810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f523d8-ca42-49ec-b495-3dd1fe35518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.945068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06f523d8-ca42-49ec-b495-3dd1fe35518e None None] MFA Rules not processed for user `dbdc6b9326be4f509f1c085d13187bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:44.946247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06f523d8-ca42-49ec-b495-3dd1fe35518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:44.955578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1227/2458] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Aug 8 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:44.966517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f9e4-d2a7-447e-a460-c549f463b8cb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:44.977887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f9e4-d2a7-447e-a460-c549f463b8cb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:44.981638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:44.982226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:44.982500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:44.982767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:44.993440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:44.994894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:45.006293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1232/2459] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:45.336673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a854-5ff7-4c24-a1b0-73b93eb7b7fe None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:45.336960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a854-5ff7-4c24-a1b0-73b93eb7b7fe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:45.337227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a854-5ff7-4c24-a1b0-73b93eb7b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:45.357144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9039a854-5ff7-4c24-a1b0-73b93eb7b7fe None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:45.358338 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9039a854-5ff7-4c24-a1b0-73b93eb7b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:45.367665 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1228/2460] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:45.391113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:45.402871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de99c-7036-4b21-8b8e-f117a9234564 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:45.408827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:45.409558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:45.409841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:45.410111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:45.419661 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:45.421434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:45.433246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1233/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:48.590219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab27e-8cea-4346-998e-2edc95a5ea2f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:48.590752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab27e-8cea-4346-998e-2edc95a5ea2f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:48.590752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab27e-8cea-4346-998e-2edc95a5ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:48.611128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5ecab27e-8cea-4346-998e-2edc95a5ea2f None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:48.612332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ecab27e-8cea-4346-998e-2edc95a5ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:48.619549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1229/2462] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:29:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:48.632187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:48.644285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fd15b-c016-4579-a301-3ced5370c00b service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:48.650059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:48.650686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:48.650961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:48.651226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:48.660840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:48.662689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:48.670586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1234/2463] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:29:49.452661 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679761e2-11ff-4e85-82e4-34842c729c29 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:49.453587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679761e2-11ff-4e85-82e4-34842c729c29 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:49.453880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679761e2-11ff-4e85-82e4-34842c729c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:49.474354 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-679761e2-11ff-4e85-82e4-34842c729c29 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:49.475600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-679761e2-11ff-4e85-82e4-34842c729c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:49.484456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1230/2464] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:29:49.507254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:49.520244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e843-5ed1-4a0a-a45c-d806e5265721 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:49.525827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:49.526425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:49.526703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:49.526974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:49.535423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:49.537024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:49.546842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1235/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:59.469807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=44 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:59.542340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=39 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:10.124478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96c69-4f85-4ba1-a4c8-165e08cd839f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:10.125058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96c69-4f85-4ba1-a4c8-165e08cd839f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:10.125058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96c69-4f85-4ba1-a4c8-165e08cd839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:10.203251 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b0b96c69-4f85-4ba1-a4c8-165e08cd839f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:10.204453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b0b96c69-4f85-4ba1-a4c8-165e08cd839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:10.254840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1231/2466] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:10.277190 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:10.343114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0672ec-d6aa-4e3b-915e-48905148690d service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:10.349099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:10.349703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:10.349980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:10.350249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:10.358912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:10.360491 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:10.371140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1236/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:11.477359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a8a34-547f-4ec6-b135-b724023245ca None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:11.477812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a8a34-547f-4ec6-b135-b724023245ca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:11.477934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a8a34-547f-4ec6-b135-b724023245ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:11.508955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8f8a8a34-547f-4ec6-b135-b724023245ca None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:11.510165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8f8a8a34-547f-4ec6-b135-b724023245ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:11.517982 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1232/2468] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:11.531568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:11.543022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb3bf-59cb-4678-8dc9-b99ab9950b1f service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:11.547992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:11.549183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:11.549607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:11.549884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:11.558030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:11.559642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:11.568319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1237/2469] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:30:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:30:14.317406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340c23-75cb-4d4f-ae5a-4e0d3cdc4d3f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:14.317917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340c23-75cb-4d4f-ae5a-4e0d3cdc4d3f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:14.317917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340c23-75cb-4d4f-ae5a-4e0d3cdc4d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:14.337455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dc340c23-75cb-4d4f-ae5a-4e0d3cdc4d3f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:14.338650 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dc340c23-75cb-4d4f-ae5a-4e0d3cdc4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:14.347225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1233/2470] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:14.368315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:14.380067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544848c-a6fa-4df6-b544-ca126f9d13af service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:14.385472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:14.386059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:14.386334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:14.386600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:14.396584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:14.398189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:14.408069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1238/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:24.332867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=55 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:24.403577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=42 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:30.491353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddc42-6713-440c-b50b-b22490901960 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:30.491897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddc42-6713-440c-b50b-b22490901960 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:30.491897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ddc42-6713-440c-b50b-b22490901960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:30.510712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-515ddc42-6713-440c-b50b-b22490901960 None None] MFA Rules not processed for user `a0edaf1628ad412392182acb6752ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:30.511910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-515ddc42-6713-440c-b50b-b22490901960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.518862 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1234/2472] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:40.506027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:44.836431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:44.837922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:44.932953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8cfe-8896-4e9b-af04-5cbd6e8597f0 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:44.937992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:44.938602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:44.938884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:44.939158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:44.941198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:44.953482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:44.955065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:44.966088 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1239/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:48.275376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.275901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.275901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.296257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:48.297488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:48.305559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1235/2474] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:48.331093 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.343246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ea7e-705b-4cb8-b99e-2567bddddf46 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.349462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.350053 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.350333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.350603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.358851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.360412 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b2c8-2f2d-42c3-9d43-dd47752ead8f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.369886 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1240/2475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:49.935036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.936452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:49.969738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1107-bfab-4a16-9a9a-3b2d0fea27bd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.974268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.974882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.975152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.975417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.977128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:49.989552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.991007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.000528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1236/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:51.582866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.583419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.583419 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.606094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:51.607790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.617494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1241/2477] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:51.638306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.652224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbcca2-d1e0-4ca5-9b1a-4d7eb5a71249 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.657719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.658854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.659306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.659770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.668466 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.670103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.681965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1237/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:53.148605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.150047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:53.165539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103df48-afbc-4179-a504-3d6c72cbb0c5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.170670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.171273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.171559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.171830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.173617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:53.186267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.187844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.197948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1242/2479] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:53.214208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.215690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:53.229976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012036e-34e0-41d5-82f3-4d18fae93b7c service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.234964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.235642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.236019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.236524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] PATH_INFO: `/v3/users/e536559b9c084a6bafb9d2ce8b493c65` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.238473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e536559b9c084a6bafb9d2ce8b493c65)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.240387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.290935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e536559b9c084a6bafb9d2ce8b493c65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.299282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e536559b9c084a6bafb9d2ce8b493c65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.307238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e536559b9c084a6bafb9d2ce8b493c65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.307917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e536559b9c084a6bafb9d2ce8b493c65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.308538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-12600472-ca10-4423-a9c0-5a6d87449c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e536559b9c084a6bafb9d2ce8b493c65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.335796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1238/2480] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:53 2022] DELETE /identity/v3/users/e536559b9c084a6bafb9d2ce8b493c65 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:53.515945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.529204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67054d1-9047-4f02-9d47-b2a2b81c9bc1 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.587143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.587776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.588057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.588330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] PATH_INFO: `/v3/projects/170491fbfb1f4deab03bc1102d215d76` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.589559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170491fbfb1f4deab03bc1102d215d76)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.591481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.632610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:53.641094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170491fbfb1f4deab03bc1102d215d76', 'request_id': 'req-35884402-a274-4d5b-8a64-34cad59d9412'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.647131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170491fbfb1f4deab03bc1102d215d76', 'request_id': 'req-35884402-a274-4d5b-8a64-34cad59d9412'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.654440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170491fbfb1f4deab03bc1102d215d76', 'request_id': 'req-35884402-a274-4d5b-8a64-34cad59d9412'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.665594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] The token cache is being invalidate because project 170491fbfb1f4deab03bc1102d215d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:53.665881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.666502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-35884402-a274-4d5b-8a64-34cad59d9412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.667962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1243/2481] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:53 2022] DELETE /identity/v3/projects/170491fbfb1f4deab03bc1102d215d76 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:53.672946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.673235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.673512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.693102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:53.694309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:53.755509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1239/2482] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:53.763971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.764253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.764518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.785158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:53.786349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:53.794087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1244/2483] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:53.798400 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.808131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ad8-3372-468d-a1b9-d6336a399e4c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.812723 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.813319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.813595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.813864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.815160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:53.815806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.816966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.828562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1240/2484] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:53.834019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.844753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825cfd1-1cf2-4bb1-8b73-efb76d84ea77 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.849710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.850321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.850596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.850864 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.851485 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.853432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.882891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1245/2485] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:53 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:53.886890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.897694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38559-0fbc-48a4-a596-12bf8b3ee0e9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.901427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:53.954697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.956066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.956356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.956630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.957339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.959269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.979636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1241/2486] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:53 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:53.983943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.994233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048661f-8683-4312-b090-8526a06a8800 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.998985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.999611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.999892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.000161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.000827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.002991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.012802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1246/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:54.016545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.027044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c655-03ee-4a5f-a755-f3d60e798222 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.031668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.032262 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.032543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.032855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.033582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.035276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a2678-6989-4dc7-a21f-e0561142c305 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.045515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1242/2488] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:54.050361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.060226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9e41-0b78-4fb6-ac9f-45c9c4e4b2e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.065428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.066150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.066435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.066705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] PATH_INFO: `/v3/projects/f796ff31b54b4568b580894a833b1440/users/0ea53d3bcb8044368933274b062010d5/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.081173 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f796ff31b54b4568b580894a833b1440, user_id=0ea53d3bcb8044368933274b062010d5, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.083813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.097839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1247/2489] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:54 2022] PUT /identity/v3/projects/f796ff31b54b4568b580894a833b1440/users/0ea53d3bcb8044368933274b062010d5/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:54.108225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.108506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.108818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.136811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] MFA Rules not processed for user `0ea53d3bcb8044368933274b062010d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:54.138021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.201236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1243/2490] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:54.205683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.268719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4d92-8394-447f-8f74-1b274983d951 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.273305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.273906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.274191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.274463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.275094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.277097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.305110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1248/2491] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:54.309154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.320452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61baf4-edf9-48ba-986b-f0fc5f55c479 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.375733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.376362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.376658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.376950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.378104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.380026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.399822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1244/2492] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:54.403816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.415019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f818e1-bfda-46f9-bbc2-d9204a76ca00 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.420028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.420699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.420983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.421263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.421909 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.423537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.435335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1249/2493] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:54.439617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.446005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:54.450004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e35fa-c9be-490a-b2d6-1a58daa915bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.456086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.456829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.457096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.457369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] PATH_INFO: `/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4/users/0025640a326a4574b47a392e7a33764b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.472633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f64b4c0b23946b3a374343e5f7aa2b4, user_id=0025640a326a4574b47a392e7a33764b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.475384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.496294 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1245/2494] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:54 2022] PUT /identity/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4/users/0025640a326a4574b47a392e7a33764b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:54.500409 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.511582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfb5e-121c-4f6f-bf71-8443be527cf6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.547789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:54.573107 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.573713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.573991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.574264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.574901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.576488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d12e11-60b5-4674-8bdd-2ef32ad3772d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.586715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1250/2495] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:54.591138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.601794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba89da3-7027-4f24-aa31-95432bc56d08 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.606628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.607266 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.607536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.607799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] PATH_INFO: `/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4/users/0025640a326a4574b47a392e7a33764b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.609715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f64b4c0b23946b3a374343e5f7aa2b4, user_id=0025640a326a4574b47a392e7a33764b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.612904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.622760 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1246/2496] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:54 2022] PUT /identity/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4/users/0025640a326a4574b47a392e7a33764b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:54.633309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.633598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.633875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.661713 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] MFA Rules not processed for user `0025640a326a4574b47a392e7a33764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:54.662922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.730702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1251/2497] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:54.741662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.743425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.821727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caaf2c-8bbe-4520-9bb9-5946f694704c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.825304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.825899 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.826178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.826446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.835280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.836706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b971873-6742-4978-aa02-c63254673c3b service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.846105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1247/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:55.001580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.064052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96351b-231c-4fec-8923-7ab766bf63a8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.069259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.069875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.070152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.070423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] PATH_INFO: `/v3/users/0ea53d3bcb8044368933274b062010d5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.071530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea53d3bcb8044368933274b062010d5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.073530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.120314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea53d3bcb8044368933274b062010d5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.128427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea53d3bcb8044368933274b062010d5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.129091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea53d3bcb8044368933274b062010d5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.129869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea53d3bcb8044368933274b062010d5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.135202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.137353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea53d3bcb8044368933274b062010d5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.156563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1252/2499] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:55 2022] DELETE /identity/v3/users/0ea53d3bcb8044368933274b062010d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:55.161094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.161380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.161653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.180002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:55.181247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.239584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1248/2500] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:55.249436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.251084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.309497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f153-4481-4a79-9fe7-0368d1d990d7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.313196 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.313796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.314078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.314353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.323824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.325224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260223-5907-45a5-9ce8-173b775ae0fc service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.335392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1253/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:55.610961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.612990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.626258 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe417d-06d3-47f9-ad4a-bc7d7802ede2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.633839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.634527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.634800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.635143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] PATH_INFO: `/v3/projects/f796ff31b54b4568b580894a833b1440` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.636226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f796ff31b54b4568b580894a833b1440)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.638191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.685227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.685576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.685867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.686139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.687890 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f796ff31b54b4568b580894a833b1440', 'request_id': 'req-824e9376-c2e9-4f78-8643-7e0b7c042410'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.695731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f796ff31b54b4568b580894a833b1440', 'request_id': 'req-824e9376-c2e9-4f78-8643-7e0b7c042410'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.703460 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f796ff31b54b4568b580894a833b1440', 'request_id': 'req-824e9376-c2e9-4f78-8643-7e0b7c042410'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.710500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:55.711871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.714787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] The token cache is being invalidate because project f796ff31b54b4568b580894a833b1440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:55.715069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.715694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.717207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1249/2502] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:55 2022] DELETE /identity/v3/projects/f796ff31b54b4568b580894a833b1440 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:55.721299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.722762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.772581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1254/2503] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:55.788988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e9376-c2e9-4f78-8643-7e0b7c042410 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.793851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.794045 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.794480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.794756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.795022 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] PATH_INFO: `/v3/users/0025640a326a4574b47a392e7a33764b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.795404 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.796180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0025640a326a4574b47a392e7a33764b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.798182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.847537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0025640a326a4574b47a392e7a33764b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.857133 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0025640a326a4574b47a392e7a33764b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.865587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0025640a326a4574b47a392e7a33764b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.866327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0025640a326a4574b47a392e7a33764b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.866952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0025640a326a4574b47a392e7a33764b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.883711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cbacb-0381-459f-8a30-e29501600b6e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.885226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1250/2504] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:55 2022] DELETE /identity/v3/users/0025640a326a4574b47a392e7a33764b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:55.892966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.956452 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.957218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.957498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.957767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.960098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.027393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.029091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b3d8-558f-4655-a8be-05f9a6225f53 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.040579 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1255/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:56.174486 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.176229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.190902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a613-16b3-4185-bc47-5d4506e0af3c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.195838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.196588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.196992 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.197336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] PATH_INFO: `/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.198911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f64b4c0b23946b3a374343e5f7aa2b4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.200488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.246986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:56.248271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f64b4c0b23946b3a374343e5f7aa2b4', 'request_id': 'req-eed89d48-8058-4b98-97f2-156042f8ea78'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.256407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f64b4c0b23946b3a374343e5f7aa2b4', 'request_id': 'req-eed89d48-8058-4b98-97f2-156042f8ea78'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.263563 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f64b4c0b23946b3a374343e5f7aa2b4', 'request_id': 'req-eed89d48-8058-4b98-97f2-156042f8ea78'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.275327 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] The token cache is being invalidate because project 1f64b4c0b23946b3a374343e5f7aa2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:56.275619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.276273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eed89d48-8058-4b98-97f2-156042f8ea78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.277787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1251/2506] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:56 2022] DELETE /identity/v3/projects/1f64b4c0b23946b3a374343e5f7aa2b4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:56.282625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.283111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.283258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.303754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:56.305008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.365037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1256/2507] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:56.374017 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.374299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.374572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.394633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:56.395826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.403651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1252/2508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:56.408089 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.417901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13227b-ac14-410d-ab5a-ca29865ab6b6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.422456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.423055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.423348 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.423602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.424919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:56.425193 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.426825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.438715 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1257/2509] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:56.443996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.453200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30885c2-d961-4849-8b0f-46dd2d087d38 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.458073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.458663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.458938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.459206 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.459826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.461766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.489453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1253/2510] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:56.493571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.504383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b205-e2e4-4cfe-aa07-a54048e8f990 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.529919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:56.562780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.563401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.563663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.563934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.565233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.567143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.586868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1258/2511] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:56.590978 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.601463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025d273-1425-4d6a-890c-6e948aca242b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.606125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.606967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.607243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.607514 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.608181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.609826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.620180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1254/2512] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:56.624111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.634638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da918-5178-4667-b7f8-a42c921380da admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.639334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.639929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.640205 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.640476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.641142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.642753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd208433-5ddd-4ec1-9aad-ba671018b808 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.653162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1259/2513] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:56.657195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.668509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb14a4-7c96-4f22-a6ec-fbe2ce7527f7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.673196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.673866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.674706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.674974 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] PATH_INFO: `/v3/projects/4827b535ee304fa5b4e27ed30d3e7df1/users/d5397431064d483797cef24ccac0ba50/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.690796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4827b535ee304fa5b4e27ed30d3e7df1, user_id=d5397431064d483797cef24ccac0ba50, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.693546 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.708159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1255/2514] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:56 2022] PUT /identity/v3/projects/4827b535ee304fa5b4e27ed30d3e7df1/users/d5397431064d483797cef24ccac0ba50/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:56.718627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.718913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.719182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.747530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] MFA Rules not processed for user `d5397431064d483797cef24ccac0ba50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:56.748918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.812850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1260/2515] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:56.818493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.880949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e23c9-9e6f-4f40-b397-5b583e77c080 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.885451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.886046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.886321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.886589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.887207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.889165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.915301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1256/2516] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:56.919323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.929972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40354df-82cb-47d1-931e-3b7b247b7661 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.987584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.988187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.988466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.988769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.989383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.991300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.011566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1261/2517] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:57.015544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.026459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243561-93f6-4e2f-aa84-465e726c0fa2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.031056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.031647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.031921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.032190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.032859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.034720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.045026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1257/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:57.049591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.059591 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310facd-be92-42f4-864a-e373d43f28f2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.064152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.065454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.065728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.065996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] PATH_INFO: `/v3/projects/dc9aab831e8144ec95487aa805dd2918/users/21bc1068d4d1423ba5bce3e636436cd7/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.084177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9aab831e8144ec95487aa805dd2918, user_id=21bc1068d4d1423ba5bce3e636436cd7, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.087090 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.100249 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1262/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:57 2022] PUT /identity/v3/projects/dc9aab831e8144ec95487aa805dd2918/users/21bc1068d4d1423ba5bce3e636436cd7/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:57.104264 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.115216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa6b-a192-4360-87c1-7af39f0325ef admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.161643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:57.176228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.177053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.177329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.177594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.178224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.179860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6d59-b23f-4d37-a23e-d2670ee819ad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.190064 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1258/2520] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:57.193898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.199694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:57.207364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552ea7-f778-46ea-b516-3a589b4b4831 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.212432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.213197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.213546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.213885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] PATH_INFO: `/v3/projects/dc9aab831e8144ec95487aa805dd2918/users/21bc1068d4d1423ba5bce3e636436cd7/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.215861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9aab831e8144ec95487aa805dd2918, user_id=21bc1068d4d1423ba5bce3e636436cd7, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.218626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.230136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1263/2521] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:57 2022] PUT /identity/v3/projects/dc9aab831e8144ec95487aa805dd2918/users/21bc1068d4d1423ba5bce3e636436cd7/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:57.242156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.242438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.242706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.273654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] MFA Rules not processed for user `21bc1068d4d1423ba5bce3e636436cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:57.275104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.345468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1259/2522] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:57.358504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.360323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.447664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954c98-ccd9-46a8-8d63-314f0ffc465e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.451494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.452177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.452567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.452954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.463501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.465020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436af2a8-faa3-4871-b26c-ce886e688f54 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.476121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1264/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:57.551851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.561347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b3092-8955-48c1-aef1-9a71c5dbfe13 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.564952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.565538 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.565811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.566077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.623405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.624864 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.633871 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1260/2524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:59.942015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedce97-8352-41d8-abdc-a5615cf12506 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:59.942578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedce97-8352-41d8-abdc-a5615cf12506 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:59.942578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedce97-8352-41d8-abdc-a5615cf12506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:59.963685 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2cedce97-8352-41d8-abdc-a5615cf12506 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:59.964906 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2cedce97-8352-41d8-abdc-a5615cf12506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:00.024836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1265/2525] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:00.046402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:00.047808 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:00.117857 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:00.122621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d12f3d-3a9c-4b5d-bd07-8d6984105c49 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:00.128969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:00.129559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:00.129832 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:00.130094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:00.138114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:00.139682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:00.149247 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1261/2526] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:04.088742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.089229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.089326 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.109314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:04.110516 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.118426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1266/2527] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 8 02:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:04.141793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:04.153894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1a3c-0afa-4d4e-8738-d2fa54a54a40 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:04.159800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:04.160419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.160735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.161009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.169122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:04.170672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:04.180491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1262/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:14.103991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:14.176041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:14.582112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.583519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.642466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a22ad6-147f-4ceb-bf3c-79400f4b4328 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.646822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.647423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.647700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.647968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.649714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.712466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.713946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.723612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1267/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:24.497238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.515566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb58-9152-4a1b-86c9-7b4d1e52950c service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.520445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.521079 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.521362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.521629 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.523488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:24.537155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.538714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.550062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1263/2530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:24.718869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=48 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:25.165969 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:25.167524 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:25.179401 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca6516-64dd-4ee8-b937-e42745d760d4 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:25.182970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:25.183571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:25.183848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:25.184113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:25.185825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:25.198197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:25.199615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:25.210135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1268/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:27.927277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.939813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968255-ab52-4186-bc8f-904abb96becc service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.947181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.947809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.948086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.948348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.953839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.978922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.987290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.990011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab975-1efc-478d-bb03-576b7a24ea32 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.991463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8d464-1e19-4f17-8fe6-794a2bcf8ecf service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:28.003540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:28.004323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.004768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.005220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] PATH_INFO: `/v3/users/d5397431064d483797cef24ccac0ba50` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.006512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5397431064d483797cef24ccac0ba50)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:28.012750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:28.014453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1264/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:28.102141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5397431064d483797cef24ccac0ba50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.116686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5397431064d483797cef24ccac0ba50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.117786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5397431064d483797cef24ccac0ba50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.118616 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5397431064d483797cef24ccac0ba50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.128028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5397431064d483797cef24ccac0ba50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.167225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1269/2533] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:27 2022] DELETE /identity/v3/users/d5397431064d483797cef24ccac0ba50 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:28.171645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670278-d787-40a2-a425-68339b72255c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.172120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670278-d787-40a2-a425-68339b72255c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.172550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670278-d787-40a2-a425-68339b72255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.207999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fb670278-d787-40a2-a425-68339b72255c None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:28.209825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fb670278-d787-40a2-a425-68339b72255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.331776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1265/2534] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:28.379549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:28.381814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.508098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbddf1-a073-41aa-a04e-c6f25d04c1d4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:28.517115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:28.517788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.518067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.518341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.529040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:28.530711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:28.544869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1270/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:28.563180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670278-d787-40a2-a425-68339b72255c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:28.565149 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fb670278-d787-40a2-a425-68339b72255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.684369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670278-d787-40a2-a425-68339b72255c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:28.690593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:28.691152 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.691388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.691666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.693581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.717898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:28.719138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:28.731157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1266/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:29.348048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.349844 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:29.401124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1796c-b9f2-4305-b445-11dcbc7930b9 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.432889 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.433603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.433883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.434197 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] PATH_INFO: `/v3/projects/4827b535ee304fa5b4e27ed30d3e7df1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.443195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4827b535ee304fa5b4e27ed30d3e7df1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.454683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.540380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4827b535ee304fa5b4e27ed30d3e7df1', 'request_id': 'req-7a17499e-d412-40d9-b78d-c17e437baa04'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.551164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:29.554016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4827b535ee304fa5b4e27ed30d3e7df1', 'request_id': 'req-7a17499e-d412-40d9-b78d-c17e437baa04'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.569436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4827b535ee304fa5b4e27ed30d3e7df1', 'request_id': 'req-7a17499e-d412-40d9-b78d-c17e437baa04'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.592136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] The token cache is being invalidate because project 4827b535ee304fa5b4e27ed30d3e7df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:29.592427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.593129 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.596050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1271/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:29 2022] DELETE /identity/v3/projects/4827b535ee304fa5b4e27ed30d3e7df1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:29.600404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.613913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be12b8-c3a9-4252-8dc2-08a0b2dd621e service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.715189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.716364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.717508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.717994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] PATH_INFO: `/v3/users/21bc1068d4d1423ba5bce3e636436cd7` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.719625 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bc1068d4d1423ba5bce3e636436cd7)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.723708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.735539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:29.805886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bc1068d4d1423ba5bce3e636436cd7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.826976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bc1068d4d1423ba5bce3e636436cd7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.837225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bc1068d4d1423ba5bce3e636436cd7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.837986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bc1068d4d1423ba5bce3e636436cd7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.838758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bc1068d4d1423ba5bce3e636436cd7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.859524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1267/2538] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:29 2022] DELETE /identity/v3/users/21bc1068d4d1423ba5bce3e636436cd7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:30.955406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:30.959025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:30.977790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17499e-d412-40d9-b78d-c17e437baa04 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.087460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.088423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.088903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.089343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] PATH_INFO: `/v3/projects/dc9aab831e8144ec95487aa805dd2918` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.090716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9aab831e8144ec95487aa805dd2918)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.092892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.195112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9aab831e8144ec95487aa805dd2918', 'request_id': 'req-f254b507-5f9e-4ba1-803a-fae4a67f1e51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.211435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9aab831e8144ec95487aa805dd2918', 'request_id': 'req-f254b507-5f9e-4ba1-803a-fae4a67f1e51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.223856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.226282 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.247004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9aab831e8144ec95487aa805dd2918', 'request_id': 'req-f254b507-5f9e-4ba1-803a-fae4a67f1e51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.263417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534687e-ebe8-46b3-bf4a-54f523bddce6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.271810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] The token cache is being invalidate because project dc9aab831e8144ec95487aa805dd2918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:31.272235 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.273059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f254b507-5f9e-4ba1-803a-fae4a67f1e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.281556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1272/2539] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:30 2022] DELETE /identity/v3/projects/dc9aab831e8144ec95487aa805dd2918 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:31.284939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ba77-e0b5-469e-b0a6-25ca1a1f3c10 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.285494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ba77-e0b5-469e-b0a6-25ca1a1f3c10 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.312302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ba77-e0b5-469e-b0a6-25ca1a1f3c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.335885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.336891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.337345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.337783 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] PATH_INFO: `/v3/users/bcf8360980c64096ab7187a38895612e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.339170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf8360980c64096ab7187a38895612e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.341942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.366372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e30ba77-e0b5-469e-b0a6-25ca1a1f3c10 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:31.367753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e30ba77-e0b5-469e-b0a6-25ca1a1f3c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.390290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1273/2540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:31.399820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.403015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.403015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.435415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf8360980c64096ab7187a38895612e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.450432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf8360980c64096ab7187a38895612e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.458505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:31.459786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.464276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf8360980c64096ab7187a38895612e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.465015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf8360980c64096ab7187a38895612e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.465639 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf8360980c64096ab7187a38895612e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:31.478179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1274/2541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:31.482784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.487599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1268/2542] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:31 2022] DELETE /identity/v3/users/bcf8360980c64096ab7187a38895612e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:31.509111 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d75bd-f24e-4fb7-b480-80ed89a0b00e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.610058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.610058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.610515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.610754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.612503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:31.612859 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.614626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.618346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:31.638963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1275/2543] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:31.640148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.648399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:31.656986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685433c7-0eff-40ba-b334-865679a43f5f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.668306 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.669105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.669393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.671846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.672552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.675701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.734640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1269/2544] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:31 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:31.740831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.760048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818978c2-7e26-46c4-b99b-9fad51ca3ad0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.891299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.891751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.892807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.892807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.894131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.899840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.952422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1276/2545] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:31 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:31.956806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.969738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc96c9-a878-4614-8571-66a35a2aa5af admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.981062 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.982235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.982521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.982795 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.983461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.985208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.001981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1270/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:32.005596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.031918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff0f4-b0e2-4205-b12e-16add9588c2f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.031918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.031918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.031918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.032487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.032487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.032487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.055446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1277/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:32.058093 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.076553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1784-8719-46d4-8c3c-a3ef1127f6da admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.085073 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.085876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.086156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.086431 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] PATH_INFO: `/v3/projects/b8b9d46e77b24954bf215092bc8dfad4/users/443999bb84514c8ea5dd5eaeb318b2e2/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.092509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.095262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.126161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d385d-0aec-4122-a895-9970356bf4a1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.136994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b9d46e77b24954bf215092bc8dfad4, user_id=443999bb84514c8ea5dd5eaeb318b2e2, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.140727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.142289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.143062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.143436 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] PATH_INFO: `/v3/projects/db302f8503ec4f56b4dd26e61ccd3d90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.144279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7255a-bfa2-412d-9183-27c43b87ed84 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.147345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=db302f8503ec4f56b4dd26e61ccd3d90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.150643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.181240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1271/2548] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:32 2022] PUT /identity/v3/projects/b8b9d46e77b24954bf215092bc8dfad4/users/443999bb84514c8ea5dd5eaeb318b2e2/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:32.185287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.186139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.186139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.257712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] MFA Rules not processed for user `443999bb84514c8ea5dd5eaeb318b2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:32.260822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.281422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db302f8503ec4f56b4dd26e61ccd3d90', 'request_id': 'req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:32.304135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db302f8503ec4f56b4dd26e61ccd3d90', 'request_id': 'req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:32.326854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db302f8503ec4f56b4dd26e61ccd3d90', 'request_id': 'req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:32.341995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] The token cache is being invalidate because project db302f8503ec4f56b4dd26e61ccd3d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:32.342442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:32.343208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1bcb769-6600-4b65-8d1a-8c62a33ce8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:32.350036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1278/2549] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:32 2022] DELETE /identity/v3/projects/db302f8503ec4f56b4dd26e61ccd3d90 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:32.353687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61468-5bf3-4a17-b3b4-108c3f6dd645 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.353974 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61468-5bf3-4a17-b3b4-108c3f6dd645 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.354368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61468-5bf3-4a17-b3b4-108c3f6dd645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.390241 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dad61468-5bf3-4a17-b3b4-108c3f6dd645 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:32.396182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dad61468-5bf3-4a17-b3b4-108c3f6dd645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.453913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1272/2550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:32.459730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.461895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.511018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:32.537176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1279/2551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:32.538956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.539246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.539521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.585395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:32.586637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.601848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1280/2552] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:32.602827 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.622009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6599d-cbe2-42cb-a5af-7ff1ff171c23 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.626365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78402d-6d4a-410d-bc78-0c570e0f47d6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.628471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.629780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.630133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.630425 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.631546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:32.632140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.635399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.637313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.638134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.638597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.639028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.639671 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.641637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.664543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1281/2553] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:32.669598 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.682198 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1273/2554] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:32.686036 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.694515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3428da-c4d6-4e74-9e5f-c942d357e056 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.729830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:32.820623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03398-903a-4148-8948-8a40f8fb6d19 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.831192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.832105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.832831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.833337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.834205 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.836394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.846601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.847232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.847513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.847787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.848422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.850406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.872634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1274/2555] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:32.878110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.890531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f2c0-66c2-4ad0-9f67-0f4861b41e14 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.897379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.898284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.898736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.899187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.899985 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.901672 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.915442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1282/2556] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:32.915645 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1275/2557] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:32.916466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.919565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.946633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2796e97-3bbc-4e45-a370-990fc249c1ad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.077264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8275-4d3c-4f25-a69d-2715dc830692 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.090695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.091368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.091656 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.091930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.092572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.096664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.145108 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.146097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.146097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.146395 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] PATH_INFO: `/v3/projects/b91d1cdab37a40a9920937a2986e7ae4/users/e8465fde91384449a1430b7893fecc3b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.152146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1283/2558] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:33.177169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.200829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d1cdab37a40a9920937a2986e7ae4, user_id=e8465fde91384449a1430b7893fecc3b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.207703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7f15-8ed8-48ed-a081-e478b0be997e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.212097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.224042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.225732 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.226247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.226632 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.227445 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.229330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.253005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1276/2559] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:32 2022] PUT /identity/v3/projects/b91d1cdab37a40a9920937a2986e7ae4/users/e8465fde91384449a1430b7893fecc3b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:33.255900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.263647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1284/2560] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:33.264807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.294815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85745-e646-487e-89a8-763bc7eda31b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.369134 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087050a-e640-424b-8ab2-2df2f00d8581 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.381840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.382829 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.383256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.384172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.385044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.388071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.402352 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1277/2561] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:33.415492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.431662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718a99-daf2-45db-ac67-1335dd5015f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.437910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.438805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.439328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.439943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] PATH_INFO: `/v3/projects/360d02ad974f4d85a68ffd76ac76e7d3/users/ea660e3b70ca4445bb59a9a79bfe714b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.452025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:33.461072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360d02ad974f4d85a68ffd76ac76e7d3, user_id=ea660e3b70ca4445bb59a9a79bfe714b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.465026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2897-8c48-4887-b189-e5fb25fbf438 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.469178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:33.496006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1278/2562] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:33 2022] PUT /identity/v3/projects/360d02ad974f4d85a68ffd76ac76e7d3/users/ea660e3b70ca4445bb59a9a79bfe714b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:33.496145 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.506614 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.506834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.507109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.519575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.519575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.519575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.525835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.527610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.547773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1285/2563] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:33.553539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.559131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] MFA Rules not processed for user `ea660e3b70ca4445bb59a9a79bfe714b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:33.560765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:33.571118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367a8d-927d-4493-a2eb-752af4c3fc76 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.706002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1279/2564] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:33.710663 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.778051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.780128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.780583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.780898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] PATH_INFO: `/v3/projects/b91d1cdab37a40a9920937a2986e7ae4/users/e8465fde91384449a1430b7893fecc3b/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.783901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d1cdab37a40a9920937a2986e7ae4, user_id=e8465fde91384449a1430b7893fecc3b, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.786774 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.811555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1286/2565] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:33 2022] PUT /identity/v3/projects/b91d1cdab37a40a9920937a2986e7ae4/users/e8465fde91384449a1430b7893fecc3b/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:33.811555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:33.811555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:33.817164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd19d-b549-4da7-a097-e40402029e7d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.898681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.899299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.899675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.899955 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.900575 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.903710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fae5f-4521-433c-9866-f6212a3a123b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.913782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0faebc-e882-48b4-8ca7-37b0c0bf6183 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:33.922759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:33.923981 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.924957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.925200 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] PATH_INFO: `/v3/users/f98f663720574804973a9e168d7a6a8e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.926479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98f663720574804973a9e168d7a6a8e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:33.928461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:33.941463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1280/2566] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:33 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:33.943243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.943702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.944290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.984884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] MFA Rules not processed for user `e8465fde91384449a1430b7893fecc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:33.986137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:33.992308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:33.996831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98f663720574804973a9e168d7a6a8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.023478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98f663720574804973a9e168d7a6a8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.026352 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98f663720574804973a9e168d7a6a8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.028234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98f663720574804973a9e168d7a6a8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.047367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98f663720574804973a9e168d7a6a8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.075156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:34.096283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1287/2567] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:33 2022] DELETE /identity/v3/users/f98f663720574804973a9e168d7a6a8e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:34.098707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.100364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.106610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1281/2568] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:34.123410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.126131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.223977 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44855d-a2a7-40fd-9305-84c587e5a127 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.300237 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320b8d-2db7-4d61-a6b7-680eb745778b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.305831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.306245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.306427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.306803 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.308264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.311588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.325398 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.330143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.330341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.331187 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.341175 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1288/2569] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:34 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:34.342349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.343954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.362611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3435c-05cd-4f5f-a9e9-06cc83c0af47 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.370135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.371223 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.371862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.372299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] PATH_INFO: `/v3/users/8ce022e19b6d44329c1208e6546433bc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.379897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce022e19b6d44329c1208e6546433bc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.379897 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.414106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.415839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.434719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1282/2570] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:34.435750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.452467 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab43d-fc8e-48ae-87fb-2544e8aca02e service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.455246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce022e19b6d44329c1208e6546433bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.462034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.462939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.463199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.463515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.464204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.466137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.468081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:34.484127 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce022e19b6d44329c1208e6546433bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.485124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce022e19b6d44329c1208e6546433bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.486655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce022e19b6d44329c1208e6546433bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.491116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1283/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:34.493730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.495979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.500390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce022e19b6d44329c1208e6546433bc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.521888 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3889e-0ed9-445c-8563-800ef1088108 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.532269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.534818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.535577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.536482 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] PATH_INFO: `/v3/users/443999bb84514c8ea5dd5eaeb318b2e2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.539465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443999bb84514c8ea5dd5eaeb318b2e2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.545472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.549961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1289/2572] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:34 2022] DELETE /identity/v3/users/8ce022e19b6d44329c1208e6546433bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:34.551490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.553339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.645806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443999bb84514c8ea5dd5eaeb318b2e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.647874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:34.660147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443999bb84514c8ea5dd5eaeb318b2e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.666391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeb6b-2091-44f0-89be-368860b1889b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.671272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443999bb84514c8ea5dd5eaeb318b2e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.672703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443999bb84514c8ea5dd5eaeb318b2e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.674126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443999bb84514c8ea5dd5eaeb318b2e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.677895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.679060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.679562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.680036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] PATH_INFO: `/v3/projects/77b160039fef4a37a1a738f77364a012/users/e9f9cff3f0414a7f9ebdd56db15558e4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.699585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b160039fef4a37a1a738f77364a012, user_id=e9f9cff3f0414a7f9ebdd56db15558e4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.699952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1284/2573] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:34 2022] DELETE /identity/v3/users/443999bb84514c8ea5dd5eaeb318b2e2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:34.702887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17ff8-c749-4c52-b931-5c8d80bedb9d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.704097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.705693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.722389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1290/2574] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:34 2022] PUT /identity/v3/projects/77b160039fef4a37a1a738f77364a012/users/e9f9cff3f0414a7f9ebdd56db15558e4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:34.723820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.724207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.724576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.748443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:34.749912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.800916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b01f8-f446-4685-b208-339bc87aa9f8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.842294 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1291/2575] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:34.843319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.846369 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.865683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcafa-c0d7-4c1d-a4d7-6e61f5a05bc6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.871337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.871953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.872231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.872421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.872577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.873180 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.873292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.873607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.873944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] PATH_INFO: `/v3/projects/cad306a125cd4d3fbfe548798137ffee` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.874794 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.875227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad306a125cd4d3fbfe548798137ffee)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.877920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.887015 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1292/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:34.887878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.889725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.897733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:34.904134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17b52-0c5d-4dba-9371-07cf7cfb8755 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.909983 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.910701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.911018 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.911366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] PATH_INFO: `/v3/projects/a120e63621f04a3b9b2dd0df7f745b40` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.912577 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a120e63621f04a3b9b2dd0df7f745b40)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.914546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:34.930353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad306a125cd4d3fbfe548798137ffee', 'request_id': 'req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.936249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad306a125cd4d3fbfe548798137ffee', 'request_id': 'req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.945042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad306a125cd4d3fbfe548798137ffee', 'request_id': 'req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.958310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] The token cache is being invalidate because project cad306a125cd4d3fbfe548798137ffee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:34.958855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.959515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.961197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1285/2577] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:34 2022] DELETE /identity/v3/projects/cad306a125cd4d3fbfe548798137ffee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:34.961949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.963448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.965203 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a120e63621f04a3b9b2dd0df7f745b40', 'request_id': 'req-d653258f-62b3-4222-bccb-7791b8353bf9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.970826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a120e63621f04a3b9b2dd0df7f745b40', 'request_id': 'req-d653258f-62b3-4222-bccb-7791b8353bf9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:34.979077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a120e63621f04a3b9b2dd0df7f745b40', 'request_id': 'req-d653258f-62b3-4222-bccb-7791b8353bf9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.028097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc5a8-b155-4bc3-997c-c6e17fb2ad9a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.081718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.082341 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.082617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.082886 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.084800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.117570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] The token cache is being invalidate because project a120e63621f04a3b9b2dd0df7f745b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:35.118108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.118696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.120254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1293/2578] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:34 2022] DELETE /identity/v3/projects/a120e63621f04a3b9b2dd0df7f745b40 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.124729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.124729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.156046 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.157738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.168256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1286/2579] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:35.169106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.170475 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.176891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:35.185260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becff68-9ff1-4d9f-9995-57dd6c66a5b7 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.192759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.193407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.193813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.194089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] PATH_INFO: `/v3/users/6b624c418baa4de6b34c2db9a75751d1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.195020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653258f-62b3-4222-bccb-7791b8353bf9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.195234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b624c418baa4de6b34c2db9a75751d1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.197730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.200754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.201540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.201995 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.202305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] PATH_INFO: `/v3/projects/77b160039fef4a37a1a738f77364a012/users/e9f9cff3f0414a7f9ebdd56db15558e4/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.203406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:35.205534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b160039fef4a37a1a738f77364a012, user_id=e9f9cff3f0414a7f9ebdd56db15558e4, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.208038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646e55-5746-4541-92d7-b38f65c85ed4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.224303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1294/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:35 2022] PUT /identity/v3/projects/77b160039fef4a37a1a738f77364a012/users/e9f9cff3f0414a7f9ebdd56db15558e4/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.226083 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffca64-9005-494c-8593-2f382e75724f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.226590 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffca64-9005-494c-8593-2f382e75724f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.226951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffca64-9005-494c-8593-2f382e75724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.250434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bcffca64-9005-494c-8593-2f382e75724f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:35.252038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bcffca64-9005-494c-8593-2f382e75724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.260555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b624c418baa4de6b34c2db9a75751d1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.271894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b624c418baa4de6b34c2db9a75751d1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.282574 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b624c418baa4de6b34c2db9a75751d1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.284055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b624c418baa4de6b34c2db9a75751d1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.285189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-377e2561-b8a0-4718-a1bc-b628e7a7827d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b624c418baa4de6b34c2db9a75751d1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.313683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1287/2581] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/users/6b624c418baa4de6b34c2db9a75751d1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.315180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8396002-e786-492b-a261-bccc27885a23 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.315469 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8396002-e786-492b-a261-bccc27885a23 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.315746 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8396002-e786-492b-a261-bccc27885a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.324031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1295/2582] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:35.342405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.342939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.343214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.368701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:35.369237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e8396002-e786-492b-a261-bccc27885a23 None None] MFA Rules not processed for user `e9f9cff3f0414a7f9ebdd56db15558e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:35.370192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.370433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8396002-e786-492b-a261-bccc27885a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.465734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1296/2583] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:35.471900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.472827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1288/2584] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:35.483070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce803b34-eb10-485c-8a05-05e26039c348 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.484557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8396002-e786-492b-a261-bccc27885a23 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.486640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8396002-e786-492b-a261-bccc27885a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.490016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.490307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.490601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.491096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.491761 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:35.492303 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.494504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.513050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1297/2585] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:35.514199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.524295 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fce0-be34-4aa9-8d82-00139375ef01 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.529837 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.530340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.530614 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.530887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.531512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.533475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.557011 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8396002-e786-492b-a261-bccc27885a23 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.561148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.561759 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.562033 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.562304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.564651 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1298/2586] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:35.569035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.581109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.584057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.622387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1289/2587] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:35.628719 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:35.646489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249bbf-4936-4a8c-b8c1-395997ae39ec admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.654789 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.656758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.658141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.659375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.660515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.660875 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.661746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.665037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.687084 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da47c9-33c6-4831-b193-ac0a7ef37293 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.694733 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.695579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.695849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.696141 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] PATH_INFO: `/v3/projects/b8b9d46e77b24954bf215092bc8dfad4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.703512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b9d46e77b24954bf215092bc8dfad4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.703512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.710320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:35.735736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1299/2588] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:35.735736 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.737136 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.767700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dfd2-c8ff-4185-a90e-6ebaf9699acc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.771393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b9d46e77b24954bf215092bc8dfad4', 'request_id': 'req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.780001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b9d46e77b24954bf215092bc8dfad4', 'request_id': 'req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.790201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b9d46e77b24954bf215092bc8dfad4', 'request_id': 'req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.807543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] The token cache is being invalidate because project b8b9d46e77b24954bf215092bc8dfad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:35.807837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.808512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.810219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1290/2589] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/projects/b8b9d46e77b24954bf215092bc8dfad4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.810818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.812175 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.856345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.857292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.857569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.857832 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] PATH_INFO: `/v3/projects/a7063467315842ee84be55ff85eafb84` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.858970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7063467315842ee84be55ff85eafb84)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.860956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.891620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e8e7-04b8-4fc3-8d81-c64aeaef59d3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.902605 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.903840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.904197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.904595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.905599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.907885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.916299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7063467315842ee84be55ff85eafb84', 'request_id': 'req-086203dd-7b90-40d9-9de6-3b03f5ce179d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.922556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1291/2590] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:35.923495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.926679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.933830 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7063467315842ee84be55ff85eafb84', 'request_id': 'req-086203dd-7b90-40d9-9de6-3b03f5ce179d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.941782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb75c-f402-46f9-aaa3-8e91e328dd48 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.943788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7063467315842ee84be55ff85eafb84', 'request_id': 'req-086203dd-7b90-40d9-9de6-3b03f5ce179d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.958746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] The token cache is being invalidate because project a7063467315842ee84be55ff85eafb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:35.959748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.960399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.964727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1300/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/projects/a7063467315842ee84be55ff85eafb84 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.964727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.964727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.012146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.015067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.015556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.016057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] PATH_INFO: `/v3/users/e8465fde91384449a1430b7893fecc3b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.018788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8465fde91384449a1430b7893fecc3b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.021165 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.084561 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086203dd-7b90-40d9-9de6-3b03f5ce179d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.090522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.091096 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.092110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.093131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.093647 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.094883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.097013 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.120630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1301/2592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:36.120630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.128088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8465fde91384449a1430b7893fecc3b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.129233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.137711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c17fd1-5996-426c-82de-1b673580e62c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.145045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8465fde91384449a1430b7893fecc3b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.147721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.148856 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.149420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.149996 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] PATH_INFO: `/v3/projects/03adf602f9a1429681315a3e941fbfc8/users/f51bdf96d099460982d5daf4d46e9022/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.157458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8465fde91384449a1430b7893fecc3b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.158876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8465fde91384449a1430b7893fecc3b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.159826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8465fde91384449a1430b7893fecc3b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.174910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03adf602f9a1429681315a3e941fbfc8, user_id=f51bdf96d099460982d5daf4d46e9022, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.182928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d6b84-2e76-4255-8714-77f31788ecd4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.190838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1292/2593] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/users/e8465fde91384449a1430b7893fecc3b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.192045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.193734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.213059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1302/2594] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:36 2022] PUT /identity/v3/projects/03adf602f9a1429681315a3e941fbfc8/users/f51bdf96d099460982d5daf4d46e9022/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:36.226775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.227060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.227417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.264583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] MFA Rules not processed for user `f51bdf96d099460982d5daf4d46e9022`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.265990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.277087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433178-cddc-4bf6-b13e-0b1076fffd64 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.341903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.342713 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.342873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.343067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] PATH_INFO: `/v3/users/ea660e3b70ca4445bb59a9a79bfe714b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.344198 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1303/2595] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.344318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea660e3b70ca4445bb59a9a79bfe714b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.346979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.372386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.373890 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.400578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea660e3b70ca4445bb59a9a79bfe714b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.410418 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea660e3b70ca4445bb59a9a79bfe714b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.416813 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.421720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea660e3b70ca4445bb59a9a79bfe714b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.424445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea660e3b70ca4445bb59a9a79bfe714b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.425480 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-49231e74-798d-4b51-ac14-a22e9ba4978f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea660e3b70ca4445bb59a9a79bfe714b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.448376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50827b-c956-483d-adbd-667a828b4d0e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.449387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1293/2596] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:36 2022] DELETE /identity/v3/users/ea660e3b70ca4445bb59a9a79bfe714b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.454092 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.454447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.455158 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.477823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.479055 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.514383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.515021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.515299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.515588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.521117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.558938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1294/2597] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:36.559788 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.561105 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.574103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419b6f5-02ff-4378-9e9e-209b4f9faceb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.579739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.581619 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.581896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.582166 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] PATH_INFO: `/v3/projects/b91d1cdab37a40a9920937a2986e7ae4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.582839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.583318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91d1cdab37a40a9920937a2986e7ae4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.585510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.603605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.605440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.616277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1304/2598] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:36.617123 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.618555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.634880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91d1cdab37a40a9920937a2986e7ae4', 'request_id': 'req-528b5300-3e45-4400-9d0f-e40123eb9d0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.641061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91d1cdab37a40a9920937a2986e7ae4', 'request_id': 'req-528b5300-3e45-4400-9d0f-e40123eb9d0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.650683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91d1cdab37a40a9920937a2986e7ae4', 'request_id': 'req-528b5300-3e45-4400-9d0f-e40123eb9d0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.664785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] The token cache is being invalidate because project b91d1cdab37a40a9920937a2986e7ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:36.665209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.666026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-528b5300-3e45-4400-9d0f-e40123eb9d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.671339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1295/2599] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:36 2022] DELETE /identity/v3/projects/b91d1cdab37a40a9920937a2986e7ae4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.672591 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d373-0be9-480e-816d-386176138216 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.673007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d373-0be9-480e-816d-386176138216 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.673476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d373-0be9-480e-816d-386176138216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.690848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55948d6b-b16f-4d5a-a809-2eaf923f2b71 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.695732 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bdc1d373-0be9-480e-816d-386176138216 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.697116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bdc1d373-0be9-480e-816d-386176138216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.745386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.745999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.746279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.748431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.750513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.759552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.777447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1296/2600] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.786290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.787302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.787523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.811737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.813556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.824521 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1297/2601] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.829465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.840188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89dee-2101-423a-a2b8-3fbba7aee0f4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.846145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.846932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.847280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.851233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.851233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:36.851233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.851233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.861351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.863801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.867123 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1298/2602] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:36.871753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.881610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1305/2603] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:36.896374 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fb7c-49a1-4b74-a252-f96d485aab80 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.902610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.903554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.903924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.904288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.905290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.907286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.952700 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1299/2604] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:36.957945 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.975246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c680-c3e6-48cf-a031-430e5a2764e8 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.038888 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.056520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.057023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.057346 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.058024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.058705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.061122 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.093210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1306/2605] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:37.098241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.108981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af15c-0157-4065-a085-e883193eabf0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.113821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.114422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.114695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.114963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.115604 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.117234 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.131956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1300/2606] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:37.133328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.144877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afaf29-9d74-4645-aa4a-1388e2de3695 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.150494 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.151105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.151384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.151873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.152573 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.154261 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.168299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1307/2607] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:37.169481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.179731 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6a13c-4b13-47c6-9230-41b036aaec9b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.186748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.187408 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.187740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.187960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] PATH_INFO: `/v3/projects/9674978b93934ba9863b145138404fa3/users/cb9ce5a201934060854ad9ee87c749bc/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.206195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9674978b93934ba9863b145138404fa3, user_id=cb9ce5a201934060854ad9ee87c749bc, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.207617 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.209483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.209623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb678a-5244-40db-9c82-6e00b0e96692 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.223639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217673-a5cf-43e9-a685-65a415db21d2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.228683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1301/2608] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:37 2022] PUT /identity/v3/projects/9674978b93934ba9863b145138404fa3/users/cb9ce5a201934060854ad9ee87c749bc/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:37.238404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.238590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.238837 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.269764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] MFA Rules not processed for user `cb9ce5a201934060854ad9ee87c749bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:37.270996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.289586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.290219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.290567 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.290840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] PATH_INFO: `/v3/projects/360d02ad974f4d85a68ffd76ac76e7d3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.292098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360d02ad974f4d85a68ffd76ac76e7d3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.294395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.342957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1302/2609] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:37.348151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.348961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360d02ad974f4d85a68ffd76ac76e7d3', 'request_id': 'req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.354748 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360d02ad974f4d85a68ffd76ac76e7d3', 'request_id': 'req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.359411 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccfd06-40af-4b5d-b9ec-4bdfcb6b013b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.363918 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360d02ad974f4d85a68ffd76ac76e7d3', 'request_id': 'req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.375928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] The token cache is being invalidate because project 360d02ad974f4d85a68ffd76ac76e7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:37.376220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.376951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.378578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1308/2610] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:37 2022] DELETE /identity/v3/projects/360d02ad974f4d85a68ffd76ac76e7d3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:37.385568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.386930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.434202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.435295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.435578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.435851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.436476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.438616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.453785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.460434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea7e8-4571-4ec2-ad5f-267b15c133e8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.461124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.467307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.468156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.468439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.468743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] PATH_INFO: `/v3/users/e9f9cff3f0414a7f9ebdd56db15558e4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.469643 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1303/2611] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:37 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:37.469917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f9cff3f0414a7f9ebdd56db15558e4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.472618 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.474407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.476005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.521604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f9cff3f0414a7f9ebdd56db15558e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.529733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f9cff3f0414a7f9ebdd56db15558e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.530718 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f9cff3f0414a7f9ebdd56db15558e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.531345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f9cff3f0414a7f9ebdd56db15558e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.539183 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f9cff3f0414a7f9ebdd56db15558e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.543196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c9f1-efac-47ca-84df-be151c18d7f7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.547988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.548853 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.549143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.549530 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.550147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.552103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.557681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1309/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:37 2022] DELETE /identity/v3/users/e9f9cff3f0414a7f9ebdd56db15558e4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:37.573122 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1304/2613] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:37 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:37.576935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.578594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.646285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358c77b-02ad-4d06-a4a1-bd7a2aeb10a2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.650965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.651576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.651858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.652121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.652792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.654372 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.668498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1310/2614] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:37.670377 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.681248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff0415-dbfe-416c-8b4c-6d6004e447e5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.685935 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.686683 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.687053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.687399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] PATH_INFO: `/v3/projects/0955473595e84ae58d13c80f37313f1e/users/4768a3e65b17405ba408324b4a8112b6/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.703529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0955473595e84ae58d13c80f37313f1e, user_id=4768a3e65b17405ba408324b4a8112b6, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.706751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.721532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1305/2615] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:37 2022] PUT /identity/v3/projects/0955473595e84ae58d13c80f37313f1e/users/4768a3e65b17405ba408324b4a8112b6/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:37.725479 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.738699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f696f9-c2d5-4a0e-9d01-792467817547 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.797597 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.798213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.798623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.798904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.799560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.801202 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.811589 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1311/2616] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:37.816539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.826854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41894e88-80b2-482f-bbe2-65783994743f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.832960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.834026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.834322 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.834735 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] PATH_INFO: `/v3/projects/0955473595e84ae58d13c80f37313f1e/users/4768a3e65b17405ba408324b4a8112b6/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.837010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0955473595e84ae58d13c80f37313f1e, user_id=4768a3e65b17405ba408324b4a8112b6, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.840488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2b3bd-dd78-48c8-b322-106d41c672ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.850023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.851963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.852406 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1306/2617] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:37 2022] PUT /identity/v3/projects/0955473595e84ae58d13c80f37313f1e/users/4768a3e65b17405ba408324b4a8112b6/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:37.865060 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.865470 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.865849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.870327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908175c-cabb-4e5d-acd4-6af0aa11074f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.874263 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.902244 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] MFA Rules not processed for user `4768a3e65b17405ba408324b4a8112b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:37.903464 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.934486 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.935039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.935316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.935583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] PATH_INFO: `/v3/projects/77b160039fef4a37a1a738f77364a012` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.936790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b160039fef4a37a1a738f77364a012)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.938816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.980737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1307/2618] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:37.998505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.999906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.013792 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b160039fef4a37a1a738f77364a012', 'request_id': 'req-90fffc03-f144-4bd4-897d-46a924d47b27'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.022501 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b160039fef4a37a1a738f77364a012', 'request_id': 'req-90fffc03-f144-4bd4-897d-46a924d47b27'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.035038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b160039fef4a37a1a738f77364a012', 'request_id': 'req-90fffc03-f144-4bd4-897d-46a924d47b27'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.046624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.048725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] The token cache is being invalidate because project 77b160039fef4a37a1a738f77364a012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:38.049189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.050142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-90fffc03-f144-4bd4-897d-46a924d47b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.052007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1312/2619] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:37 2022] DELETE /identity/v3/projects/77b160039fef4a37a1a738f77364a012 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:38.056745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901e3d-4531-4930-bdc7-f0e386897a36 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.057273 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901e3d-4531-4930-bdc7-f0e386897a36 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.057545 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901e3d-4531-4930-bdc7-f0e386897a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.070852 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517cabd-5b33-4d3d-846e-fa7a96447d92 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.089984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ab901e3d-4531-4930-bdc7-f0e386897a36 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:38.091896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab901e3d-4531-4930-bdc7-f0e386897a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.137270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.138008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.138290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.138556 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.140356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.159382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1313/2620] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:38.166697 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.167008 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.167283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.188370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:38.190307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.199144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1314/2621] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:38.203341 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.213776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc3e0-6605-453c-a977-f8b8c18e50d5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.218594 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.219432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.219787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.220156 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.221028 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.221928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:38.222508 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.222819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.225415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.233227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1308/2622] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:38.239503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1315/2623] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:38.244184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.255474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730e5da-0605-4ac4-bb4e-8fddd5c6cb3f service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.261701 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.262402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.262741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.263077 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.263855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.265914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.297478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1309/2624] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:38.301811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.312072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8791c7-59d2-41dc-8deb-43ee79b36aae admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.326783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.379197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.381930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.400220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.401554 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.401955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.402325 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.404064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.408556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.453855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1316/2625] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:38.453855 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.456967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab1fbb-47fc-4ade-aedb-8d2cc6ea1194 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.462194 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.462824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.463094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.463438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.464340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.465472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319ee1-1231-4a27-881f-73fbe9ca5918 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.466010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.473006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.473946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.474349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.474685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] PATH_INFO: `/v3/users/cb9ce5a201934060854ad9ee87c749bc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.476381 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9ce5a201934060854ad9ee87c749bc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.478565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.484333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1317/2626] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:38.488357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.503420 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.506845 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5afb-4c77-4b39-b49d-3ee182aa9550 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.519248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.519946 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.520636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.521438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.522219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.524588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.539333 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1318/2627] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:38.544489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.550190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9ce5a201934060854ad9ee87c749bc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.556992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e38b-2e5b-4cee-82d7-fa4d144cfc5b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.561188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9ce5a201934060854ad9ee87c749bc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.562773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.563459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.563777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.564665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] PATH_INFO: `/v3/projects/91094fbf452246918d736da47177294e/users/ac2bbd4e3d62413a8d05d7ce0c9c8036/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.579336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9ce5a201934060854ad9ee87c749bc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.581934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9ce5a201934060854ad9ee87c749bc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.584312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a422917-9c4c-4346-8012-c02ed04aa622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9ce5a201934060854ad9ee87c749bc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.590066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91094fbf452246918d736da47177294e, user_id=ac2bbd4e3d62413a8d05d7ce0c9c8036, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.593470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd1795-93ea-416e-976d-0d08b72f065e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.609212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1319/2628] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:38 2022] PUT /identity/v3/projects/91094fbf452246918d736da47177294e/users/ac2bbd4e3d62413a8d05d7ce0c9c8036/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:38.615347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1310/2629] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:38 2022] DELETE /identity/v3/users/cb9ce5a201934060854ad9ee87c749bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:38.619817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.620146 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.620415 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.620971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.621437 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.621716 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.641074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:38.642364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.651843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] MFA Rules not processed for user `ac2bbd4e3d62413a8d05d7ce0c9c8036`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:38.653088 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.707377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1320/2630] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:38.717653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.721753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.724009 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1311/2631] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:38.728768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.730160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.744382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6d54b-c0b8-44b5-9d64-0107710fea27 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.748936 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.749535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.749815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.750090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.750719 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.752676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.779422 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5593-60e9-43af-8c27-f0cae98ff3d6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.780129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1312/2632] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:38.784809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.795509 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.834861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.835490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.835766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.836028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.848373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e85a-f302-4b30-863a-9d3da04566f0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.853098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.853707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.853984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.854256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.854903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.857101 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.868811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.891213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1313/2633] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:38.892897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.906117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a71c-c5f2-435a-b940-96c43c4e1371 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.910847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.911444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.911582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.911739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.911981 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.912617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.912991 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.914224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.923005 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1321/2634] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:38.927474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1314/2635] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:38.928507 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.938022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20cfe3-3f10-43ea-9662-6b3d68c1a5e2 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.943470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.944124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.944405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.944698 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] PATH_INFO: `/v3/projects/1f028bea16bd436682764c4001ec841e/users/ee3979d2977f4161af1a6561427dcb9e/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.960521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f028bea16bd436682764c4001ec841e, user_id=ee3979d2977f4161af1a6561427dcb9e, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.963500 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.976622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1322/2636] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:38 2022] PUT /identity/v3/projects/1f028bea16bd436682764c4001ec841e/users/ee3979d2977f4161af1a6561427dcb9e/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:38.980765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.992115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbfa0-499f-4e6a-bc5f-dd1bfae4c58a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.052339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.053013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.053265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.053537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.054173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.055803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd013e8c-e86a-4b98-a80b-6572fa62a79c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.067548 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1315/2637] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:39.072814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.082956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce18f9d-83f1-4ff4-a68a-3ede0051f4e0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.088475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.089169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.089460 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.090247 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] PATH_INFO: `/v3/projects/1f028bea16bd436682764c4001ec841e/users/ee3979d2977f4161af1a6561427dcb9e/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.092279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f028bea16bd436682764c4001ec841e, user_id=ee3979d2977f4161af1a6561427dcb9e, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.094990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.106299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1323/2638] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:39 2022] PUT /identity/v3/projects/1f028bea16bd436682764c4001ec841e/users/ee3979d2977f4161af1a6561427dcb9e/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:39.118730 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.119014 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.119280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.148822 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] MFA Rules not processed for user `ee3979d2977f4161af1a6561427dcb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:39.149860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.209046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.211476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.224695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1316/2639] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:39.238494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.241250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.284607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e46-bc70-4f79-b2cc-2cda7730e3e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.289254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.289885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.290176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.290430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] PATH_INFO: `/v3/projects/9674978b93934ba9863b145138404fa3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.291556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9674978b93934ba9863b145138404fa3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.293535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.303207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067d27-c8c1-443e-a749-1e78e40bff0a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.307004 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.307616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.307903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.308291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.318453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.319898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.329269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:39.330439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1317/2640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:39.344042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9674978b93934ba9863b145138404fa3', 'request_id': 'req-576ea821-a6bd-4807-b3eb-84a63d4da49f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.349899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9674978b93934ba9863b145138404fa3', 'request_id': 'req-576ea821-a6bd-4807-b3eb-84a63d4da49f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.357711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9674978b93934ba9863b145138404fa3', 'request_id': 'req-576ea821-a6bd-4807-b3eb-84a63d4da49f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.370097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] The token cache is being invalidate because project 9674978b93934ba9863b145138404fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:39.370396 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.371336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.373076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1324/2641] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:39 2022] DELETE /identity/v3/projects/9674978b93934ba9863b145138404fa3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:39.377423 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.388068 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da327b0-5ca2-419e-b8c2-fadf4d9a90a8 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.393010 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:39.447585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.448227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.448506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.448812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] PATH_INFO: `/v3/users/4768a3e65b17405ba408324b4a8112b6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.449954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4768a3e65b17405ba408324b4a8112b6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.451859 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.506554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4768a3e65b17405ba408324b4a8112b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.517807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4768a3e65b17405ba408324b4a8112b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.528066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4768a3e65b17405ba408324b4a8112b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.528827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4768a3e65b17405ba408324b4a8112b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.530024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4768a3e65b17405ba408324b4a8112b6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.555776 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1318/2642] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:39 2022] DELETE /identity/v3/users/4768a3e65b17405ba408324b4a8112b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:39.700854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.703150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.796583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea821-a6bd-4807-b3eb-84a63d4da49f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.867975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee3979d2977f4161af1a6561427dcb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f028bea16bd436682764c4001ec841e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.868613 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.868926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.869277 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.870132 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:39.870366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.872086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.885823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1325/2643] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:39.893139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.894696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.899924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.902514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.912889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58f3b-1c2a-4142-a083-e169e18a099e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.917876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee3979d2977f4161af1a6561427dcb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f028bea16bd436682764c4001ec841e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.918562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.918921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.919784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.919911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.921998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.960686 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1319/2644] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:39 2022] POST /identity/v3/projects => generated 354 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:39.962481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.991048 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f499-d380-4850-aecc-1c11cc57d556 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.996720 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.070838 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7094-2ef8-4418-8235-18eac7963c61 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.076332 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee3979d2977f4161af1a6561427dcb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f028bea16bd436682764c4001ec841e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.076781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.076989 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.077273 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.077547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.077691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.078028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.078226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:40.078424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] PATH_INFO: `/v3/projects/0955473595e84ae58d13c80f37313f1e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.078555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.080423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0955473595e84ae58d13c80f37313f1e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.080684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.082572 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.089750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.097356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1320/2645] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:40.134895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.135158 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0955473595e84ae58d13c80f37313f1e', 'request_id': 'req-a9199685-3aef-4025-a47a-f0ac882b1b26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.141036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0955473595e84ae58d13c80f37313f1e', 'request_id': 'req-a9199685-3aef-4025-a47a-f0ac882b1b26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.146038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8cb5-a977-4773-9c55-cf0589a1db1a tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.150360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0955473595e84ae58d13c80f37313f1e', 'request_id': 'req-a9199685-3aef-4025-a47a-f0ac882b1b26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.162622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] The token cache is being invalidate because project 0955473595e84ae58d13c80f37313f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:40.162902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.163669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a9199685-3aef-4025-a47a-f0ac882b1b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.165439 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1326/2646] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:39 2022] DELETE /identity/v3/projects/0955473595e84ae58d13c80f37313f1e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:40.170814 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72198b-d6dd-4ff6-88b5-513a3a9db7c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.171101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72198b-d6dd-4ff6-88b5-513a3a9db7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.171377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72198b-d6dd-4ff6-88b5-513a3a9db7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.191133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3f72198b-d6dd-4ff6-88b5-513a3a9db7c1 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.192360 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3f72198b-d6dd-4ff6-88b5-513a3a9db7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.204477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee3979d2977f4161af1a6561427dcb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f028bea16bd436682764c4001ec841e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.205749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.205998 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.206265 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] PATH_INFO: `/v3/projects/60b0a01036b44350961605b784b0cf93` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.207388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60b0a01036b44350961605b784b0cf93)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.209318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.255394 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1327/2647] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:40.257183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b0a01036b44350961605b784b0cf93', 'request_id': 'req-92aae3d6-4739-42ca-8bc5-e104b59944e0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.263342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.263629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.263743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b0a01036b44350961605b784b0cf93', 'request_id': 'req-92aae3d6-4739-42ca-8bc5-e104b59944e0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.263902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.271489 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b0a01036b44350961605b784b0cf93', 'request_id': 'req-92aae3d6-4739-42ca-8bc5-e104b59944e0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.283181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] The token cache is being invalidate because project 60b0a01036b44350961605b784b0cf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:40.283476 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.284126 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.284511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.285659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1321/2648] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:40 2022] DELETE /identity/v3/projects/60b0a01036b44350961605b784b0cf93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:40.285914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.320583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.349385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1328/2649] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:40.353728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.365305 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aae3d6-4739-42ca-8bc5-e104b59944e0 tempest-VolumeQuotaClassesTest-1959557018 tempest-VolumeQuotaClassesTest-1959557018-project-admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.372459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.373170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.373520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.373971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.374714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:40.375095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.377008 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.390271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1322/2650] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:40.394777 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.404103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60229e7c-f33e-4fa9-a479-1e32d3a64182 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.412521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.412521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.412521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.412521 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.412861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.413120 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.443104 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1329/2651] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:40.447283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.457640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095853e-37de-454d-924c-c282c8973f1f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.491770 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.493871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.521433 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.521962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.522236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.522501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.523114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.525056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.546950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1323/2652] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:40.551255 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.561988 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162f66-5f1a-47d7-bf81-38518e4b505e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.562599 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c88e-7ebe-4596-94f2-5df64fec1fd1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.567354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.567551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.567960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.568076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.568261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.568367 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.568531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.568628 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] PATH_INFO: `/v3/users/ac2bbd4e3d62413a8d05d7ce0c9c8036` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.569277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.573870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2bbd4e3d62413a8d05d7ce0c9c8036)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.573870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.576070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.577752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.588835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1324/2653] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:40.592889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.605401 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4239-f92f-496e-8970-e32753650336 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.612971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.613764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.614042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.614350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.615031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.616770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.624305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2bbd4e3d62413a8d05d7ce0c9c8036'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.629280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1325/2654] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:40.635391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2bbd4e3d62413a8d05d7ce0c9c8036'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.635391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2bbd4e3d62413a8d05d7ce0c9c8036'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.635391 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2bbd4e3d62413a8d05d7ce0c9c8036'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.637894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.639613 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.643919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e329e0fa-8d5f-41a3-a8b6-4b7ca8dd12fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2bbd4e3d62413a8d05d7ce0c9c8036'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.653512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200f6e-7ea2-4b8a-a3c6-c83de28d9239 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.659191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.659947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.660295 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.660876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] PATH_INFO: `/v3/projects/9984b29e9f9a4f9184d647c1490394c5/users/da22f98e239340ba96f7785fc8fe8d77/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.668416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1330/2655] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:40 2022] DELETE /identity/v3/users/ac2bbd4e3d62413a8d05d7ce0c9c8036 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:40.672558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.672877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.673154 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.680293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9984b29e9f9a4f9184d647c1490394c5, user_id=da22f98e239340ba96f7785fc8fe8d77, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.683901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffbe55-3e2e-47c9-8559-f64255850c8e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.697588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.699094 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.710402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1326/2656] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:40 2022] PUT /identity/v3/projects/9984b29e9f9a4f9184d647c1490394c5/users/da22f98e239340ba96f7785fc8fe8d77/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:40.713069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.713618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.714184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.742542 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.745738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] MFA Rules not processed for user `da22f98e239340ba96f7785fc8fe8d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.746986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.778220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1331/2657] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:40.789683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.791387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.841127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1327/2658] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:40.862284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c528c9-9eb0-468e-b4ef-7fa8ed137871 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.866527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.867153 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.867464 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.867695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.873770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.875373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.879420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.881157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.893887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1332/2659] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:40.940578 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2f22c-b2a3-41e6-8873-fe99c82d2b1e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.944796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.945539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.945882 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.946223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.956551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.958238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827806f6-8fec-483d-bdb2-997a694bb084 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.969678 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1328/2660] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:40.987274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.997986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8826a-cb1a-4b2a-aacd-26230bf6aa69 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.002738 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.003518 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.003891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.004255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] PATH_INFO: `/v3/users/da22f98e239340ba96f7785fc8fe8d77` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.005538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da22f98e239340ba96f7785fc8fe8d77)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.007800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.069231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da22f98e239340ba96f7785fc8fe8d77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.078042 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da22f98e239340ba96f7785fc8fe8d77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.078795 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da22f98e239340ba96f7785fc8fe8d77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.079448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da22f98e239340ba96f7785fc8fe8d77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.089954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da22f98e239340ba96f7785fc8fe8d77'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.115514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1333/2661] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:40 2022] DELETE /identity/v3/users/da22f98e239340ba96f7785fc8fe8d77 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:41.120229 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.120515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.120817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.162900 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:41.164168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.230157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:41.259654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1329/2662] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:41.270976 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.272562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.284159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.285596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.305960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f9dc-8d7a-4106-8f36-d2f4efd5bc74 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.311283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.312199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.312517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.312964 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] PATH_INFO: `/v3/projects/91094fbf452246918d736da47177294e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.314984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91094fbf452246918d736da47177294e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.317097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.388453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088db3c-ab4e-4858-a523-bae8280edd04 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.394109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91094fbf452246918d736da47177294e', 'request_id': 'req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.395637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:41.404993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91094fbf452246918d736da47177294e', 'request_id': 'req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.418197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91094fbf452246918d736da47177294e', 'request_id': 'req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.435348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] The token cache is being invalidate because project 91094fbf452246918d736da47177294e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:41.435640 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.436319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.440725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1330/2663] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:41 2022] DELETE /identity/v3/projects/91094fbf452246918d736da47177294e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:41.444666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.451607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.453370 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.454121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.455170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.455503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.457470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.548351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15d59-6ecd-4f25-a84f-d3f5e5cae870 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.558311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.558715 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.559188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.559823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] PATH_INFO: `/v3/users/ee3979d2977f4161af1a6561427dcb9e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.564596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3979d2977f4161af1a6561427dcb9e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.567309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.578218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.581075 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.593653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1334/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:41.594315 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.596549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.616848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226c0-a1e0-4646-b434-ec04db420002 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.626032 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.627790 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.628209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.628595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] PATH_INFO: `/v3/users/a0edaf1628ad412392182acb6752ea0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.633683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0edaf1628ad412392182acb6752ea0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.636767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.658909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3979d2977f4161af1a6561427dcb9e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.670644 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3979d2977f4161af1a6561427dcb9e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.686881 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3979d2977f4161af1a6561427dcb9e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.688526 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3979d2977f4161af1a6561427dcb9e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.690454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3979d2977f4161af1a6561427dcb9e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.703557 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:41.718345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1331/2665] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:41 2022] DELETE /identity/v3/users/ee3979d2977f4161af1a6561427dcb9e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:41.718801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0edaf1628ad412392182acb6752ea0a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.729652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0edaf1628ad412392182acb6752ea0a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.730357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0edaf1628ad412392182acb6752ea0a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.731004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0edaf1628ad412392182acb6752ea0a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.739982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0edaf1628ad412392182acb6752ea0a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:41.761151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1335/2666] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:41 2022] DELETE /identity/v3/users/a0edaf1628ad412392182acb6752ea0a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:42.015051 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.016566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.073406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.076030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.110721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb6f9-c158-4f10-b438-7f838f9d85d2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.138528 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.194821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c3cf-54aa-4a19-944d-e596bd09bdfc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.198802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.199599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.199884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.200154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] PATH_INFO: `/v3/projects/8cb89a07cb6542589153e96fbc9a729b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.201290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.201611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb89a07cb6542589153e96fbc9a729b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.202414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.202903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.203371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] PATH_INFO: `/v3/projects/9984b29e9f9a4f9184d647c1490394c5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.203636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.205623 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9984b29e9f9a4f9184d647c1490394c5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.208402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.265556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9984b29e9f9a4f9184d647c1490394c5', 'request_id': 'req-99c28199-a095-4967-80e0-13bdfca0e26e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.268330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb89a07cb6542589153e96fbc9a729b', 'request_id': 'req-cf706697-f12e-4855-bf84-5669a56fb60e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.273022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9984b29e9f9a4f9184d647c1490394c5', 'request_id': 'req-99c28199-a095-4967-80e0-13bdfca0e26e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.276606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb89a07cb6542589153e96fbc9a729b', 'request_id': 'req-cf706697-f12e-4855-bf84-5669a56fb60e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.282140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9984b29e9f9a4f9184d647c1490394c5', 'request_id': 'req-99c28199-a095-4967-80e0-13bdfca0e26e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.287089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb89a07cb6542589153e96fbc9a729b', 'request_id': 'req-cf706697-f12e-4855-bf84-5669a56fb60e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.295142 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] The token cache is being invalidate because project 9984b29e9f9a4f9184d647c1490394c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:42.295442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.296131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.298177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1336/2667] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:42 2022] DELETE /identity/v3/projects/9984b29e9f9a4f9184d647c1490394c5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:42.298695 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.300069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.303076 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] The token cache is being invalidate because project 8cb89a07cb6542589153e96fbc9a729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:42.303488 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.308906 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf706697-f12e-4855-bf84-5669a56fb60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.312695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1332/2668] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:42 2022] DELETE /identity/v3/projects/8cb89a07cb6542589153e96fbc9a729b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:42.312695 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba444a-9075-4583-bc50-fbef736ecebb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.313183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba444a-9075-4583-bc50-fbef736ecebb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.313267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba444a-9075-4583-bc50-fbef736ecebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.334656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2aba444a-9075-4583-bc50-fbef736ecebb None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:42.336148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2aba444a-9075-4583-bc50-fbef736ecebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.386129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.402170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c28199-a095-4967-80e0-13bdfca0e26e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.456214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1333/2669] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:42.458957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.459248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.459790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.491784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:42.493130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.499756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.500416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.500747 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.501052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] PATH_INFO: `/v3/projects/1f028bea16bd436682764c4001ec841e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.502930 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f028bea16bd436682764c4001ec841e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.504895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.505102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1334/2670] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:42.513651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.525070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.526027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd91b7-2c70-43d9-bed0-ef81260f2afa None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.531925 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.532933 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.533379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.533966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.534699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:42.535071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.536765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.552636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1335/2671] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:42.557297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.568952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbde94-c8e8-40bc-b96d-0cc95134f735 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.576128 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f028bea16bd436682764c4001ec841e', 'request_id': 'req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.583800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f028bea16bd436682764c4001ec841e', 'request_id': 'req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.596289 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f028bea16bd436682764c4001ec841e', 'request_id': 'req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.609462 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] The token cache is being invalidate because project 1f028bea16bd436682764c4001ec841e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:42.609798 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.610454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4f5457f9-4f81-4ed7-a115-1990bbd71bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:42.612686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1337/2672] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:42 2022] DELETE /identity/v3/projects/1f028bea16bd436682764c4001ec841e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:42.618417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e58b-807d-4b41-9c16-b404b99983a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.618705 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e58b-807d-4b41-9c16-b404b99983a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.619036 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e58b-807d-4b41-9c16-b404b99983a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.640019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3885e58b-807d-4b41-9c16-b404b99983a5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:42.641237 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.641385 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3885e58b-807d-4b41-9c16-b404b99983a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.641855 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.642303 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.642485 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.643289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.645687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.657281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1338/2673] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:42.659756 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.660140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.660431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.676627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1336/2674] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:42.680903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.682168 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:42.682535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.683366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.745514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1339/2675] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:42.750169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.753388 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97faa5-4163-4872-be14-9dc412e14f97 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.758191 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.758802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.759081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.759364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.760083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.760382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b19e2-85de-49d7-97aa-4fca1a47ca5b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.762040 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.765179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.765773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.766059 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.766327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.767539 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:42.767840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.769438 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.781809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1340/2676] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:42.786459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.789722 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1337/2677] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:42.790594 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.799389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a03d4-7a0d-492f-b9f8-84dd2e571454 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.800724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034148-1f4e-4250-9afa-53310488cb38 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.804139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.804767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.805049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.805322 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.805782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.805939 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.806641 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.807007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.807350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.807820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.808128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.809843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.820172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1338/2678] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:42.824161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.835308 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2811-998f-4715-b248-f64c3059086a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.839030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1341/2679] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:42.840050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.850497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.898647 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.899261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.899540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.899815 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.900298 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.900454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.902160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.904300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a31cc-0b33-4e5b-9d8d-c54922a4bd74 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.911056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.911942 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.912526 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.912836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.916204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1339/2680] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:42.916354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.916354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.917218 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.929309 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f601-43ca-4855-8a60-acf8f2bf1a86 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.934812 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.935463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.935740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.936007 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] PATH_INFO: `/v3/projects/7ebbd76da93841f4a77036c261a6d86b/users/b97886e46fa147fd87514876a1d318e4/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.942316 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1342/2681] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:42.943405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.952056 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebbd76da93841f4a77036c261a6d86b, user_id=b97886e46fa147fd87514876a1d318e4, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.953281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254835-4c9c-4c0f-b7f6-1d9918052862 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.954938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.958408 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.959003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.959282 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.959627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.960227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.961941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583389c-5903-493c-99d8-3443a15afeeb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.969182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1340/2682] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:42 2022] PUT /identity/v3/projects/7ebbd76da93841f4a77036c261a6d86b/users/b97886e46fa147fd87514876a1d318e4/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:42.972674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1343/2683] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:42.976181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.980547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.980860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.981155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.010900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] MFA Rules not processed for user `b97886e46fa147fd87514876a1d318e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.012134 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.039667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e45ded-e55f-4b0b-8030-9751a46d3fea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.044396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.045027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.045307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.045585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.046227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.047854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.061424 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1341/2684] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:43.062429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.072611 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d3874-fcd5-4045-a038-4127c21a38c9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.077361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.077887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1344/2685] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:43.078021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.078313 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.078653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] PATH_INFO: `/v3/projects/8ef88f472be04082bd036731c5b34513/users/2e24774901054c5d8d4ef0e3d007542b/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.082339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.092796 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9a80-4661-4017-ac24-2cf2a0c511f3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.093702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef88f472be04082bd036731c5b34513, user_id=2e24774901054c5d8d4ef0e3d007542b, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.096597 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c6cbb-9f39-4864-9447-1e57114616ab admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.097474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.098063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.098338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.098638 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.099253 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.101213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.111529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1342/2686] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:43 2022] PUT /identity/v3/projects/8ef88f472be04082bd036731c5b34513/users/2e24774901054c5d8d4ef0e3d007542b/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:43.122638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.122930 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.123227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.132584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1345/2687] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:43.133812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.152044 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] MFA Rules not processed for user `2e24774901054c5d8d4ef0e3d007542b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.153307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.196908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b9c5-6484-48c7-9669-47215645631c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.201367 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:43.201533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.202144 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.202426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.202725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.203525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.205787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.221317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1343/2688] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:43.225839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.230907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1346/2689] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:43.231860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.237362 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf8648-dc4d-4494-abde-5504d999a6e7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.241999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.242281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e5cf2-85df-40ed-a90b-c63fa49b054d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.242596 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.242884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.243154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.243773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.245724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.247108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.247727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.248040 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.248262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.248925 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.250700 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.263226 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1347/2690] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:43.268498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.278462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1344/2691] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:43.278861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00dcd9-ba67-40e2-bf11-29527cde7dfb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.279682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.298903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:43.339065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.339717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.339994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.340262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] PATH_INFO: `/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9/users/32c7151ea3e34ee18ad6a7336e2cdb22/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.342869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c662-68b3-4567-95fd-f048852a8a6f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.347618 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.348227 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.348529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.348922 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.349580 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.351577 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.354968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8496c1b1a49d4a999fe5928ff0231bc9, user_id=32c7151ea3e34ee18ad6a7336e2cdb22, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.357898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.371215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1348/2692] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:43 2022] PUT /identity/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9/users/32c7151ea3e34ee18ad6a7336e2cdb22/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:43.374383 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1345/2693] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:43.375517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.378337 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.388950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc671a5-2607-4bc6-a278-6153e0a86b06 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.444456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211df066-d5f2-4079-9a89-6fcd0769701e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.449757 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.450365 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.450505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.450643 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.450900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.451058 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.451339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.451534 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.451634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.452249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.453155 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.453873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.463258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1349/2694] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:43.465224 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1346/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:43.467264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.470800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.477364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421956-6513-4719-87fd-71ac19d60718 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.480540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d512a-c4f6-4d7a-a93f-a5ea17dda661 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.482262 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.482907 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.483187 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.483457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] PATH_INFO: `/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9/users/32c7151ea3e34ee18ad6a7336e2cdb22/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.485407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.485574 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8496c1b1a49d4a999fe5928ff0231bc9, user_id=32c7151ea3e34ee18ad6a7336e2cdb22, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.486726 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.487012 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.487280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] PATH_INFO: `/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd/users/daf0eba1df4e49228add0cce33a8a2df/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.488668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.501481 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1350/2696] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:43 2022] PUT /identity/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9/users/32c7151ea3e34ee18ad6a7336e2cdb22/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:43.502947 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdaf6d7faf2d49d8863827ad55b8d2cd, user_id=daf0eba1df4e49228add0cce33a8a2df, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.505740 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d42584-337c-4a3c-94cb-fecbea17ade7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.526681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1347/2697] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:43 2022] PUT /identity/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd/users/daf0eba1df4e49228add0cce33a8a2df/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:43.530800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.569240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.569814 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.570252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.605413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] MFA Rules not processed for user `32c7151ea3e34ee18ad6a7336e2cdb22`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.606547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.607714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5163-aa11-4486-8eda-b5986d228986 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.628279 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:43.649980 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:43.676876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.677525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.677816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.678084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.678723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.680321 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.685150 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1348/2698] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:43.692689 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1351/2699] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:43.694957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.696562 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.698320 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.705762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218df1ec-41bb-4c88-914f-0afce0c80a9d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.710447 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.711109 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.711385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.711658 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] PATH_INFO: `/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd/users/daf0eba1df4e49228add0cce33a8a2df/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.714045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdaf6d7faf2d49d8863827ad55b8d2cd, user_id=daf0eba1df4e49228add0cce33a8a2df, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.716430 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960437-1074-44a4-9737-eab9895124a7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.727755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1349/2700] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:43 2022] PUT /identity/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd/users/daf0eba1df4e49228add0cce33a8a2df/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:43.739830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.740117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.740394 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.761382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031958db-670d-4974-bbd2-6b48b4c989a7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.769940 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] MFA Rules not processed for user `daf0eba1df4e49228add0cce33a8a2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.771183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.814655 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.815276 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.815553 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.815824 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.849302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1350/2701] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:43.857419 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.858762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.872151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f672a-6e25-4a17-a674-dd06a86e5485 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.875806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.877183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.877462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.877709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.877817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.879151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.886910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.888347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.888498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1352/2702] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:43.898585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1351/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:43.993884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.003267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5958f-db4b-459d-a1d8-953eeded532b service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.007723 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.008949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.008949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.008949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.053390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:44.071841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.073522 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf7b8-d570-401c-9dd3-300ab3e1cc6d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.083064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1353/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:44.362917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.424461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a48b0-a287-43b0-8875-c62e8aea47ed service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.429029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.429659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.429934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.430204 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] PATH_INFO: `/v3/users/2e24774901054c5d8d4ef0e3d007542b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.431512 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e24774901054c5d8d4ef0e3d007542b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.433360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.451565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:44.483130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e24774901054c5d8d4ef0e3d007542b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:44.490634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e24774901054c5d8d4ef0e3d007542b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:44.497628 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e24774901054c5d8d4ef0e3d007542b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:44.498284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e24774901054c5d8d4ef0e3d007542b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:44.498876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e24774901054c5d8d4ef0e3d007542b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:44.516595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1352/2705] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:44 2022] DELETE /identity/v3/users/2e24774901054c5d8d4ef0e3d007542b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:44.522037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.522515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.522515 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.541601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:44.542801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:44.600977 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1354/2706] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:44.611155 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.612717 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:44.670050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2259d6-6015-486d-9750-af93e2f90c09 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.674145 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.674754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.675034 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.675304 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.684751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.686183 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.696230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1353/2707] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:44.978619 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.980302 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:44.994345 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48770e5f-e340-471c-8a6d-40078f6d85b0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.998984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.999653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.999935 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.000210 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] PATH_INFO: `/v3/projects/8ef88f472be04082bd036731c5b34513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.001354 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef88f472be04082bd036731c5b34513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.003283 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.051596 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef88f472be04082bd036731c5b34513', 'request_id': 'req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.057140 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef88f472be04082bd036731c5b34513', 'request_id': 'req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.064309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef88f472be04082bd036731c5b34513', 'request_id': 'req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.075636 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] The token cache is being invalidate because project 8ef88f472be04082bd036731c5b34513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:45.075970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.076595 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.078105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1355/2708] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:44 2022] DELETE /identity/v3/projects/8ef88f472be04082bd036731c5b34513 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:45.082670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.092110 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377945-28dc-435c-b96c-dc83a196e307 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:45.150001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:45.150583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.150866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.151137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] PATH_INFO: `/v3/users/daf0eba1df4e49228add0cce33a8a2df` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.152263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf0eba1df4e49228add0cce33a8a2df)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.154236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.194772 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:45.202144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf0eba1df4e49228add0cce33a8a2df'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.212741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf0eba1df4e49228add0cce33a8a2df'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.220340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf0eba1df4e49228add0cce33a8a2df'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.221048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf0eba1df4e49228add0cce33a8a2df'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.221653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf0eb7eb-0a03-49ab-aba3-94afdd93308c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf0eba1df4e49228add0cce33a8a2df'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.240356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1354/2709] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:45 2022] DELETE /identity/v3/users/daf0eba1df4e49228add0cce33a8a2df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:45.541938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.543544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.562645 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8acd-024c-4f03-9e06-c6c2cbc57cc0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:45.623710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:45.624338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.624615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.624913 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] PATH_INFO: `/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.626027 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdaf6d7faf2d49d8863827ad55b8d2cd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.628443 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.634634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:45.681709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdaf6d7faf2d49d8863827ad55b8d2cd', 'request_id': 'req-673c6e8e-feb7-45e0-88ba-2997aa2ba622'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.687031 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdaf6d7faf2d49d8863827ad55b8d2cd', 'request_id': 'req-673c6e8e-feb7-45e0-88ba-2997aa2ba622'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.694299 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdaf6d7faf2d49d8863827ad55b8d2cd', 'request_id': 'req-673c6e8e-feb7-45e0-88ba-2997aa2ba622'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.705733 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] The token cache is being invalidate because project bdaf6d7faf2d49d8863827ad55b8d2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:45.706019 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.706646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-673c6e8e-feb7-45e0-88ba-2997aa2ba622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.708206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1356/2710] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:45 2022] DELETE /identity/v3/projects/bdaf6d7faf2d49d8863827ad55b8d2cd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:45.713045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.713510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.713633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.733559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:45.734756 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.800263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1355/2711] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:45.802010 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.802301 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.802604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.807787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.809299 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.821057 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb493d9-6fc6-43cd-9fd5-7672f93f6b92 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:45.822793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:45.823992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.825664 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:45.826286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.826565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.826830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] PATH_INFO: `/v3/users/f51bdf96d099460982d5daf4d46e9022` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.827953 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51bdf96d099460982d5daf4d46e9022)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.830649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.832873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1357/2712] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:45.837119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.847049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe28240-9163-4d7b-bf7f-140d7df802f6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:45.851659 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:45.852239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.852634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.852933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.853571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:45.853868 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.855434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.867924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1358/2713] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:45.872505 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.882239 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3342194-22cb-4b6f-8f53-757f5488032e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:45.883876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51bdf96d099460982d5daf4d46e9022'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.886821 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:45.887392 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.887666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.887929 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.888538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:45.890564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:45.891481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51bdf96d099460982d5daf4d46e9022'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.899559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51bdf96d099460982d5daf4d46e9022'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.900249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51bdf96d099460982d5daf4d46e9022'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.900898 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e79d138d-6690-4fe0-bd46-ebfd60433ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51bdf96d099460982d5daf4d46e9022'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:45.918399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1359/2714] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:45 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:45.922634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:45.922904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1356/2715] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:45 2022] DELETE /identity/v3/users/f51bdf96d099460982d5daf4d46e9022 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:45.924580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.927035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:45.927320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:45.927595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:45.946547 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:45.947679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:45.972957 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:45.991565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfa172-c479-424f-ab86-dcbe24f4ef82 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.011307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1357/2716] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:46.022634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.024219 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.048816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.049423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.049703 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.049967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.050576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.052451 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.060219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:46.075242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1360/2717] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:45 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:46.079858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.082777 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b92d2d-8baa-4163-a686-b3819b9e8f72 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.086378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.086986 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.087260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.087529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.089475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555144e-d0fa-4c34-9e31-bfd615dc3c6f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.094021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.094652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.094944 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.095786 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.096426 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.097173 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.098070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.098586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.108335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1361/2718] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:46.108473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1358/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:46.112217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.121706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eec49-cf51-4a19-970f-4485c2c09508 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.126905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.127535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.127821 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.128071 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.128724 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.130296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb00c94-5b8b-4d68-9006-bf7c42ed659a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.140220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1359/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:46.144604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.154631 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413d7b-7043-4d43-8b7d-973f1ab1700d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.160026 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.160702 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.160985 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.161255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] PATH_INFO: `/v3/projects/d1ad540aeada4263b24f5316bb14119d/users/324372cdd78c46dda83c07e30dc208a5/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.177754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ad540aeada4263b24f5316bb14119d, user_id=324372cdd78c46dda83c07e30dc208a5, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.180414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.193220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1362/2721] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:46 2022] PUT /identity/v3/projects/d1ad540aeada4263b24f5316bb14119d/users/324372cdd78c46dda83c07e30dc208a5/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:46.204667 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.205138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.205609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.234609 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] MFA Rules not processed for user `324372cdd78c46dda83c07e30dc208a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:46.236911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.312966 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1360/2722] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:46.325095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.326834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.391612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30e4f-5ae8-423a-bc5e-9e39d567cf60 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.394019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.395451 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.395570 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.396176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.396453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.396752 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.410949 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.417615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.428125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1363/2723] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:46.466357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:46.467151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.468877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.491472 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5f89-b9cb-46b0-8916-51175753d5d4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.496560 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.497311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.497589 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.497856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] PATH_INFO: `/v3/projects/03adf602f9a1429681315a3e941fbfc8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.498983 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03adf602f9a1429681315a3e941fbfc8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.503001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.553430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab1d07-ad9c-4e85-8f4c-8620e7a3770e service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.565770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03adf602f9a1429681315a3e941fbfc8', 'request_id': 'req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.574050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03adf602f9a1429681315a3e941fbfc8', 'request_id': 'req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.582984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03adf602f9a1429681315a3e941fbfc8', 'request_id': 'req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.595435 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] The token cache is being invalidate because project 03adf602f9a1429681315a3e941fbfc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:46.595799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.596543 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa7f089d-46b6-4d58-aa3b-bc1c2e28eb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.601202 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1361/2724] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:46 2022] DELETE /identity/v3/projects/03adf602f9a1429681315a3e941fbfc8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:46.603310 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a6ec-eb78-4ca3-8e94-7d6ccf74e848 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.603840 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a6ec-eb78-4ca3-8e94-7d6ccf74e848 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.604455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a6ec-eb78-4ca3-8e94-7d6ccf74e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.622513 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.623152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.623437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.623712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] PATH_INFO: `/v3/users/b97886e46fa147fd87514876a1d318e4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.624891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97886e46fa147fd87514876a1d318e4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.627471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.628185 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7703a6ec-eb78-4ca3-8e94-7d6ccf74e848 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:46.629496 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7703a6ec-eb78-4ca3-8e94-7d6ccf74e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.632910 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:46.637728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1362/2725] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:46.646679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.647287 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.647579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.673867 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:46.675196 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.683742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1363/2726] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:46.688566 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.692407 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97886e46fa147fd87514876a1d318e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.700822 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97886e46fa147fd87514876a1d318e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.701456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97886e46fa147fd87514876a1d318e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.701606 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae6d9-1f7b-4b30-8e2a-1fca3ee17b0b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.702139 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97886e46fa147fd87514876a1d318e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.707762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.708344 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.708582 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.708891 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.709539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:46.709846 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.711549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f72855a-e6ce-4251-8f4c-9d673ae83cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97886e46fa147fd87514876a1d318e4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:46.711673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.725786 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1364/2727] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:46.730021 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.732272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.734078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1364/2728] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:46 2022] DELETE /identity/v3/users/b97886e46fa147fd87514876a1d318e4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:46.738717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.739002 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.739279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.746082 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee1f7d-7727-4879-aa12-b339f56223e4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.764082 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:46.765964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.811802 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.812573 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.812869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.813138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.813926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.815969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.844087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1365/2729] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:46.851176 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.852753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.856601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1365/2730] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:46.862289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.917799 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:46.938955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff073-8e6f-4dd1-aad4-98ba3650d9c5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.945042 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762db87-270d-48d2-929d-eedf3ecc6819 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.953342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.954142 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.955572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.955707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.956626 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.959590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.985166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:46.989261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1366/2731] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:46.993209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.000057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.000512 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.000815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.001079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.005242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c235b-5414-4cc0-95d8-925217081dda admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.010805 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.011259 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.011462 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.011741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.012130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.012693 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.012871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.014363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.023873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1366/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:47.025917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1367/2733] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:47.033450 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.043751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea039-25ee-4db7-a7bd-c303b90e0799 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.048984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.049580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.049850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.050112 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.050746 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.052330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7d5d6-f949-4ec8-afb2-f3e18d10cca8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.063097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1367/2734] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:47.067559 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.077688 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aec5ec-8a0e-49b8-ab70-98a63edc207d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.082712 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.083426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.083702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.083970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] PATH_INFO: `/v3/projects/422e181887c14ea9b27385973c28fc49/users/64b8f9ec0df04625a189e4748433f579/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.100550 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422e181887c14ea9b27385973c28fc49, user_id=64b8f9ec0df04625a189e4748433f579, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.103243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.118958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1368/2735] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:47 2022] PUT /identity/v3/projects/422e181887c14ea9b27385973c28fc49/users/64b8f9ec0df04625a189e4748433f579/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:47.131164 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.131482 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.131759 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.186007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] MFA Rules not processed for user `64b8f9ec0df04625a189e4748433f579`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:47.187257 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.263784 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1368/2736] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:47.275520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.277249 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.334904 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.336687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.377078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e31e6-9ffc-4d05-8e6a-6ef91bedfaa8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.383835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.384608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.385031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.385307 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.396339 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.398290 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.407721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1369/2737] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:47.429137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084fa59-8be8-4b2c-8d8c-c649ae6e3afa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.438281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.438503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.438947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.439477 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] PATH_INFO: `/v3/projects/7ebbd76da93841f4a77036c261a6d86b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.442966 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebbd76da93841f4a77036c261a6d86b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.448078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.504978 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebbd76da93841f4a77036c261a6d86b', 'request_id': 'req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.513908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebbd76da93841f4a77036c261a6d86b', 'request_id': 'req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.518767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:47.524431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebbd76da93841f4a77036c261a6d86b', 'request_id': 'req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.540361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] The token cache is being invalidate because project 7ebbd76da93841f4a77036c261a6d86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:47.540768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.541490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.543029 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1369/2738] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:47 2022] DELETE /identity/v3/projects/7ebbd76da93841f4a77036c261a6d86b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:47.546937 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.558385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b7b12-4612-4fb2-9fc3-c3ab2304618a service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.628049 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.628551 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.629041 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.629365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.629845 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] PATH_INFO: `/v3/users/32c7151ea3e34ee18ad6a7336e2cdb22` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.630121 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.631153 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c7151ea3e34ee18ad6a7336e2cdb22)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.633595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.646812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b6e9-4c4d-4a2c-8ab6-bfb0c937e23c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.651563 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.652195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.652475 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.652809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] PATH_INFO: `/v3/users/64b8f9ec0df04625a189e4748433f579` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.653955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b8f9ec0df04625a189e4748433f579)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.655955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.656825 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:47.689384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c7151ea3e34ee18ad6a7336e2cdb22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.698070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c7151ea3e34ee18ad6a7336e2cdb22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.706627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c7151ea3e34ee18ad6a7336e2cdb22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.707372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c7151ea3e34ee18ad6a7336e2cdb22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.707999 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-42a238e3-5978-41c3-b9e5-007f6642bf83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c7151ea3e34ee18ad6a7336e2cdb22'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.712209 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b8f9ec0df04625a189e4748433f579'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.719731 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b8f9ec0df04625a189e4748433f579'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.720908 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b8f9ec0df04625a189e4748433f579'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.721527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b8f9ec0df04625a189e4748433f579'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.727458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1370/2739] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:47 2022] DELETE /identity/v3/users/32c7151ea3e34ee18ad6a7336e2cdb22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:47.729434 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b8f9ec0df04625a189e4748433f579'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:47.750565 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1370/2740] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:47 2022] DELETE /identity/v3/users/64b8f9ec0df04625a189e4748433f579 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:47.755649 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.755934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.756260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.777491 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:47.778729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.844111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1371/2741] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:47.854245 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:47.855745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:47.924291 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cd08-c588-4fb7-8da8-42ef4d4dda29 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:47.928206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:47.928842 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:47.929141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:47.929424 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:47.939716 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:47.942924 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:47.955402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1371/2742] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:48.053174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.054842 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:48.070351 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbffd74-b706-4665-9be7-483d75be8f1f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.081132 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.081379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.081552 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.082156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] PATH_INFO: `/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.083680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8496c1b1a49d4a999fe5928ff0231bc9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.086066 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.142863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8496c1b1a49d4a999fe5928ff0231bc9', 'request_id': 'req-fd17d772-00da-46dd-b023-1af7c1a8ffda'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.149357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8496c1b1a49d4a999fe5928ff0231bc9', 'request_id': 'req-fd17d772-00da-46dd-b023-1af7c1a8ffda'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.162162 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8496c1b1a49d4a999fe5928ff0231bc9', 'request_id': 'req-fd17d772-00da-46dd-b023-1af7c1a8ffda'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.180931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] The token cache is being invalidate because project 8496c1b1a49d4a999fe5928ff0231bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:48.181203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.181880 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd17d772-00da-46dd-b023-1af7c1a8ffda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.183979 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1372/2743] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:48 2022] DELETE /identity/v3/projects/8496c1b1a49d4a999fe5928ff0231bc9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:48.321351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.322878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:48.350580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cfaf-6b3b-4bc2-947d-a4536963bd51 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.421717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.422366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.422646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.422922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] PATH_INFO: `/v3/projects/422e181887c14ea9b27385973c28fc49` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.424911 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] RBAC: Authorizing `identity:delete_project(project_id=422e181887c14ea9b27385973c28fc49)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.426861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.437118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:48.478961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422e181887c14ea9b27385973c28fc49', 'request_id': 'req-6441811d-d93d-41c6-bb1b-ff506b0e36be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.484828 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422e181887c14ea9b27385973c28fc49', 'request_id': 'req-6441811d-d93d-41c6-bb1b-ff506b0e36be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.493248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422e181887c14ea9b27385973c28fc49', 'request_id': 'req-6441811d-d93d-41c6-bb1b-ff506b0e36be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.505470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] The token cache is being invalidate because project 422e181887c14ea9b27385973c28fc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:48.505760 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.506405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6441811d-d93d-41c6-bb1b-ff506b0e36be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:48.507870 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1372/2744] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:48 2022] DELETE /identity/v3/projects/422e181887c14ea9b27385973c28fc49 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:48.512833 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.513117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.513387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.534677 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:48.535903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:48.552690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:48.599653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1373/2745] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:48.607834 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.608119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.608395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.629070 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:48.630288 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:48.638328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1373/2746] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:48.643281 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.653225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9e3c-f2f6-4dc5-85f5-d77993cb50c0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.657926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.658516 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.658794 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.659067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.659711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:48.660119 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.661797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.674366 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1374/2747] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:48.678668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.688068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11052e0d-106e-4221-abd6-b7bc3f4f2a38 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.693535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.694143 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.694423 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.694696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.695339 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.697363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.726227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1374/2748] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:48 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:48.730774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.741635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30bfa-241d-45ca-b310-2f910fa7cbc3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.799904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.800711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.800993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.801263 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.801924 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.803856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.824602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1375/2749] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:48 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:48.828884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.840192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983e3b-5ebd-4df5-870d-e2ba6eda065f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.844848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.846074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.846355 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.846629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.847269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.848898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.859251 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1375/2750] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:48.863209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.873497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11dbd4-5344-4068-abb2-4fed86532849 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.878497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.879120 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.879490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.879710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.880261 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.881902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b642f0c-d799-4ff7-a50f-7d68c15722e0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.893787 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1376/2751] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:48.897895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:48.908989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866602-38f5-4419-8064-984e2b472b9a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:48.913707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:48.914371 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.914654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.914928 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] PATH_INFO: `/v3/projects/e3e158458f15421db0d44354222ccd79/users/ed4a73313b524b1da19e380211a753e2/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.930952 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e158458f15421db0d44354222ccd79, user_id=ed4a73313b524b1da19e380211a753e2, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:48.933646 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:48.948550 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1376/2752] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:48 2022] PUT /identity/v3/projects/e3e158458f15421db0d44354222ccd79/users/ed4a73313b524b1da19e380211a753e2/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:48.959600 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:48.959908 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:48.960180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:48.989137 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] MFA Rules not processed for user `ed4a73313b524b1da19e380211a753e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:48.990289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:49.058130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1377/2753] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:49.062626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.128285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2673b-e9c0-4abd-8101-01bf70f0c6e7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.133080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.133612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.133891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.134186 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.134780 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.136691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.167395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1377/2754] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:49 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:49.168473 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.180513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f1a3-5165-4339-9b9b-141f374b9a78 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.194201 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:49.240513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.241067 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.241365 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.241637 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.242271 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.244193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.266272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1378/2755] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:49 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:49.270328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.281097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a185-42c4-4ae6-8c92-128c01744aee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.286605 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.287216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.287493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.287789 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.288430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.290086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.301704 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1378/2756] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:49.306115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.316761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f7cd-cf40-4678-8556-32c40645b42e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.321446 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.322104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.322385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.322656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] PATH_INFO: `/v3/projects/f5614142029c479981d49a9a5d2a2150/users/6b7b5813570244dbad7bc1947f1baec5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.337810 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5614142029c479981d49a9a5d2a2150, user_id=6b7b5813570244dbad7bc1947f1baec5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.340539 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.354125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1379/2757] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:49 2022] PUT /identity/v3/projects/f5614142029c479981d49a9a5d2a2150/users/6b7b5813570244dbad7bc1947f1baec5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:49.360252 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.369179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f0efe-1f11-4e53-9639-4930cd8b6230 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.372968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:49.433543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.434149 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.434431 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.434727 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.435428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.437092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296198a-f7df-483d-ab6e-101bc05cfdb8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.448487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1379/2758] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:49.452603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.463413 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd604-fc15-4d5a-ac3f-5e3122cecfdb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.467963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.468603 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.468910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.469179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] PATH_INFO: `/v3/projects/f5614142029c479981d49a9a5d2a2150/users/6b7b5813570244dbad7bc1947f1baec5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.471168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5614142029c479981d49a9a5d2a2150, user_id=6b7b5813570244dbad7bc1947f1baec5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.474115 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.485147 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1380/2759] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:49 2022] PUT /identity/v3/projects/f5614142029c479981d49a9a5d2a2150/users/6b7b5813570244dbad7bc1947f1baec5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:49.497519 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.497737 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.498016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.527688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] MFA Rules not processed for user `6b7b5813570244dbad7bc1947f1baec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:49.528953 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:49.596706 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1380/2760] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:49.608896 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.610727 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:49.668389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a958eed-6d1f-424f-9d23-8a1f1d349397 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.672053 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.672668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.672958 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.673223 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.683267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.684721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.694796 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1381/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:49.772068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:49.782707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17d25a-f84f-4c2a-b045-1e9c6492d4bb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:49.788959 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:49.789575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.789852 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.790125 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.850602 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:49.852039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89a7d5-8bef-468b-84d3-d9be6e812c2f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:49.861483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1381/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:56.673684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.739098 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692fbf-ad6b-4c99-8588-021ed3ddae57 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.743623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.744260 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.744532 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.744835 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] PATH_INFO: `/v3/users/ed4a73313b524b1da19e380211a753e2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.745942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4a73313b524b1da19e380211a753e2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.747865 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.766806 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:56.796176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4a73313b524b1da19e380211a753e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:56.803884 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4a73313b524b1da19e380211a753e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:56.810931 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4a73313b524b1da19e380211a753e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:56.811544 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4a73313b524b1da19e380211a753e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:56.812180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4a73313b524b1da19e380211a753e2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:56.829861 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1382/2763] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:56 2022] DELETE /identity/v3/users/ed4a73313b524b1da19e380211a753e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:56.834892 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.835347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.835490 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.855787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:56.857056 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:56.878474 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:56.919085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1382/2764] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:56.929854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.931412 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:56.990877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ead5-502e-452c-8e9d-c0ce735a795b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.994579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.995186 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.995465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.995737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.004675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.006792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.016390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1383/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:57.286941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:57.288469 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:57.305347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064dfc8-7931-4f21-9613-91871e07ad90 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:57.310682 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:57.311448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.311679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.311997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] PATH_INFO: `/v3/projects/e3e158458f15421db0d44354222ccd79` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.313375 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e158458f15421db0d44354222ccd79)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.315560 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.363343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e158458f15421db0d44354222ccd79', 'request_id': 'req-2cb192cf-2185-44b9-a92b-5c52b305edd2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.369663 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e158458f15421db0d44354222ccd79', 'request_id': 'req-2cb192cf-2185-44b9-a92b-5c52b305edd2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.376873 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e158458f15421db0d44354222ccd79', 'request_id': 'req-2cb192cf-2185-44b9-a92b-5c52b305edd2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.388151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] The token cache is being invalidate because project e3e158458f15421db0d44354222ccd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:57.388440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.389095 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.390566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1383/2766] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:57 2022] DELETE /identity/v3/projects/e3e158458f15421db0d44354222ccd79 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:57.394509 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:57.404268 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffaec-3edf-4072-b1d6-c6f6c04a1434 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:57.461331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:57.461971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.462709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.462993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] PATH_INFO: `/v3/users/6b7b5813570244dbad7bc1947f1baec5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.464146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7b5813570244dbad7bc1947f1baec5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.466094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.513755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:57.523617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7b5813570244dbad7bc1947f1baec5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.531298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7b5813570244dbad7bc1947f1baec5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.538690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7b5813570244dbad7bc1947f1baec5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.539318 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7b5813570244dbad7bc1947f1baec5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.539914 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c083f84-2691-4d43-b3d3-c36c3d9227a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7b5813570244dbad7bc1947f1baec5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.557217 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1384/2767] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:57 2022] DELETE /identity/v3/users/6b7b5813570244dbad7bc1947f1baec5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:57.833150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:57.834791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:57.849847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192cf-2185-44b9-a92b-5c52b305edd2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:57.914950 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:57.915586 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.915862 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.916131 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] PATH_INFO: `/v3/projects/f5614142029c479981d49a9a5d2a2150` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.917255 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5614142029c479981d49a9a5d2a2150)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.919191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.966533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5614142029c479981d49a9a5d2a2150', 'request_id': 'req-da19fb11-d78a-40d5-9636-567ce1085321'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.968353 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:57.973030 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5614142029c479981d49a9a5d2a2150', 'request_id': 'req-da19fb11-d78a-40d5-9636-567ce1085321'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.980766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5614142029c479981d49a9a5d2a2150', 'request_id': 'req-da19fb11-d78a-40d5-9636-567ce1085321'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.993014 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] The token cache is being invalidate because project f5614142029c479981d49a9a5d2a2150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:57.993323 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.993947 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da19fb11-d78a-40d5-9636-567ce1085321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:57.995403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1384/2768] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:57 2022] DELETE /identity/v3/projects/f5614142029c479981d49a9a5d2a2150 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:58.000243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.000725 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.000885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.020659 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:58.022209 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:58.080189 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1385/2769] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:58.088076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.088361 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.088634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.110009 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:58.111212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:58.119809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1385/2770] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:58.123876 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.133895 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616fdfa-b7be-43ab-956b-9a48a9f6c17a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.138456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.139050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.139330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.139599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.140240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:58.140541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.142167 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.153515 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1386/2771] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:58.157802 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.167552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245a287-b5e3-47cf-91a0-205f05d88890 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.172080 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.172686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.172975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.173233 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.173881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.175776 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.202384 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1386/2772] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:58.206623 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.216633 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632d43-3f4e-4aa5-8cca-b41a145a6d36 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.272753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.273357 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.273635 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.273905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.274551 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.276465 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.297610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1387/2773] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:58.301728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.313068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64502-809b-43ee-b90c-539985310d94 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.317683 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.318427 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.318709 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.318984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.319633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.321264 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.331453 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1387/2774] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:58.335380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.345316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfe54a-8707-4021-9e96-68dd476c80d8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.350382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.350965 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.351238 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.351504 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.352138 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.353751 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fa7c-6924-4558-b462-ff1192f3eb12 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.364288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1388/2775] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:58.369113 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.378809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6538996-a284-4471-a3bb-e86d4dd2e07b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.383483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.384117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.384393 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.384686 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] PATH_INFO: `/v3/projects/50f1398819cd47bd8af801fe8a7e3c78/users/22a7f9d2b4e542799dee1f2c7c7093e7/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.399635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f1398819cd47bd8af801fe8a7e3c78, user_id=22a7f9d2b4e542799dee1f2c7c7093e7, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.402383 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.415861 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1388/2776] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:58 2022] PUT /identity/v3/projects/50f1398819cd47bd8af801fe8a7e3c78/users/22a7f9d2b4e542799dee1f2c7c7093e7/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:58.427742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.428023 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.428297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.457225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] MFA Rules not processed for user `22a7f9d2b4e542799dee1f2c7c7093e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:58.458522 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:58.468410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:58.526685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1389/2777] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:58.531254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.594058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bc25-c484-4c51-a858-7554af81053e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.598699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.599413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.599691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.599962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.600581 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.602489 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.628743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1389/2778] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:58.633743 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.644481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fdce6-b0b0-46b7-8270-1cfdf15fa21c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.699987 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.700587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.700912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.701180 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.701792 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.703773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.724018 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1390/2779] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:58.728011 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.738753 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edec763-61f5-4d64-8e7e-68d9bd4f1fab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.743902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.744495 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.744815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.745084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.745717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.747285 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.758022 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1390/2780] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:58.761962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.771841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed9d9-a1f9-4f24-9c01-332e76a0af1d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.776458 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.777143 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.777421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.777692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] PATH_INFO: `/v3/projects/1c5fa83ce3564448b7282a273009c775/users/e0fee0e1c9c940bf97318d9955cab76d/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.794035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5fa83ce3564448b7282a273009c775, user_id=e0fee0e1c9c940bf97318d9955cab76d, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.796755 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.811254 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1391/2781] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:58 2022] PUT /identity/v3/projects/1c5fa83ce3564448b7282a273009c775/users/e0fee0e1c9c940bf97318d9955cab76d/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:58.815314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.825157 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcf37-a6f3-4e5b-be0f-f33d2610589a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.872047 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:58.882778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.883376 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.883650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.883914 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.884541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.886310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a78ef-15ce-446b-9d8f-2ac70d9036fb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.895984 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1391/2782] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:58.900537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.910778 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9600e3-2c58-4418-8808-9491dd1d5fd7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.916013 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.916748 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.917038 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.917311 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] PATH_INFO: `/v3/projects/1c5fa83ce3564448b7282a273009c775/users/e0fee0e1c9c940bf97318d9955cab76d/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.919231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5fa83ce3564448b7282a273009c775, user_id=e0fee0e1c9c940bf97318d9955cab76d, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.921920 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:58.932932 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1392/2783] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:58 2022] PUT /identity/v3/projects/1c5fa83ce3564448b7282a273009c775/users/e0fee0e1c9c940bf97318d9955cab76d/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:58.944087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.944366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.944637 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.971232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] MFA Rules not processed for user `e0fee0e1c9c940bf97318d9955cab76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:58.972420 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.040044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1392/2784] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:31:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:59.051333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:59.053684 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.109083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087338-6f96-4b0b-834e-da360fd94149 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:59.112621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:59.113232 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:59.113503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:59.113766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:59.123031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:59.124448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:59.133714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1393/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:59.216329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:59.226069 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959386b-bb20-4163-a688-d96b4f272d1e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:59.229622 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:59.230204 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:59.230498 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:59.230771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:59.287903 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:59.289377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c38d9-2fec-4908-ba04-10d1014ccb5e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:59.298199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1393/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:03.980944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.986687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:04.049257 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d83a1-baaa-4724-b418-f5b8d999b9bd service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.054602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.055230 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.055505 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.055770 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] PATH_INFO: `/v3/users/22a7f9d2b4e542799dee1f2c7c7093e7` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.056916 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a7f9d2b4e542799dee1f2c7c7093e7)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.059016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.112432 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a7f9d2b4e542799dee1f2c7c7093e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.119330 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a7f9d2b4e542799dee1f2c7c7093e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.126707 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a7f9d2b4e542799dee1f2c7c7093e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.127382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a7f9d2b4e542799dee1f2c7c7093e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.130615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a7f9d2b4e542799dee1f2c7c7093e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.147371 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1394/2787] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:03 2022] DELETE /identity/v3/users/22a7f9d2b4e542799dee1f2c7c7093e7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:04.152050 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.152540 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.152745 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.172905 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:04.174271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.234025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1394/2788] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:04.243739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.245373 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.304960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef6525-b77e-4425-bf5c-e7a3ce9591fd admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.308858 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.309674 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.310027 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.310426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.321124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.322766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.332169 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1395/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:04.602558 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.604078 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.616811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda487e5-2da9-4935-aa83-5aa459c37155 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.621687 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.622387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.622665 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.622967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] PATH_INFO: `/v3/projects/50f1398819cd47bd8af801fe8a7e3c78` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.624114 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f1398819cd47bd8af801fe8a7e3c78)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.626124 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.633588 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:04.673575 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f1398819cd47bd8af801fe8a7e3c78', 'request_id': 'req-7f81cab0-4b09-474d-8478-f2c220d5d91a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.679071 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f1398819cd47bd8af801fe8a7e3c78', 'request_id': 'req-7f81cab0-4b09-474d-8478-f2c220d5d91a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.686234 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f1398819cd47bd8af801fe8a7e3c78', 'request_id': 'req-7f81cab0-4b09-474d-8478-f2c220d5d91a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.698003 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] The token cache is being invalidate because project 50f1398819cd47bd8af801fe8a7e3c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:04.698293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.698919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.700388 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1395/2790] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:04 2022] DELETE /identity/v3/projects/50f1398819cd47bd8af801fe8a7e3c78 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:04.704325 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.714682 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47be8-6821-4a4f-9ab2-8bf2842ff5fe service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.737954 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:04.772841 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.773468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.773745 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.774015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] PATH_INFO: `/v3/users/e0fee0e1c9c940bf97318d9955cab76d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.775125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fee0e1c9c940bf97318d9955cab76d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.777083 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.822753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fee0e1c9c940bf97318d9955cab76d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.829951 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fee0e1c9c940bf97318d9955cab76d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.837517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fee0e1c9c940bf97318d9955cab76d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.838161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fee0e1c9c940bf97318d9955cab76d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.838753 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fee0e1c9c940bf97318d9955cab76d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:04.856102 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1396/2791] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:04 2022] DELETE /identity/v3/users/e0fee0e1c9c940bf97318d9955cab76d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:05.123530 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.125025 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.137993 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81cab0-4b09-474d-8478-f2c220d5d91a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.203457 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.204152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.204433 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.204734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] PATH_INFO: `/v3/projects/1c5fa83ce3564448b7282a273009c775` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.205881 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5fa83ce3564448b7282a273009c775)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.207779 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.212356 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.213868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.227498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d439b-f3d6-4d50-bb22-e1daacf52384 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.232002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.232917 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.233192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.233457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] PATH_INFO: `/v3/users/324372cdd78c46dda83c07e30dc208a5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.234588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324372cdd78c46dda83c07e30dc208a5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.236599 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.257694 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5fa83ce3564448b7282a273009c775', 'request_id': 'req-04e3c1c7-bbb7-47ba-99a8-4080512148d6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.264161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5fa83ce3564448b7282a273009c775', 'request_id': 'req-04e3c1c7-bbb7-47ba-99a8-4080512148d6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.272768 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5fa83ce3564448b7282a273009c775', 'request_id': 'req-04e3c1c7-bbb7-47ba-99a8-4080512148d6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.284337 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] The token cache is being invalidate because project 1c5fa83ce3564448b7282a273009c775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:05.284625 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.285265 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-04e3c1c7-bbb7-47ba-99a8-4080512148d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.286769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1396/2792] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:05 2022] DELETE /identity/v3/projects/1c5fa83ce3564448b7282a273009c775 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:05.288571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324372cdd78c46dda83c07e30dc208a5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.291351 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02a-7d72-49b7-9dd8-3fc8371899d2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.291999 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02a-7d72-49b7-9dd8-3fc8371899d2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.292271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02a-7d72-49b7-9dd8-3fc8371899d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.297168 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324372cdd78c46dda83c07e30dc208a5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.305804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324372cdd78c46dda83c07e30dc208a5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.307006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324372cdd78c46dda83c07e30dc208a5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.307624 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9f56c887-4964-41d4-ae22-b6385e17b566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324372cdd78c46dda83c07e30dc208a5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.312021 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b628b02a-7d72-49b7-9dd8-3fc8371899d2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:05.313311 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b628b02a-7d72-49b7-9dd8-3fc8371899d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.327826 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1397/2793] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:05 2022] DELETE /identity/v3/users/324372cdd78c46dda83c07e30dc208a5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:05.332131 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.332393 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.332680 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.333927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:05.354939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:05.356213 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.368994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:05.381815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1397/2794] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:05.389525 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.389874 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.390214 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.409975 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:05.411850 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.419146 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1398/2795] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:05.420327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1398/2796] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:05.425653 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.431666 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.434258 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.436298 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f4bd4-7140-4d3a-a913-12c97dd2ff1e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.440847 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.441448 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.441720 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.441984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.442697 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:05.442997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.444956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.456035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1399/2797] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:05.460286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.470283 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467566c5-7da3-488b-b90d-4a038f9641b3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.475372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.475963 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.476236 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.476507 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.477276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.479184 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.492664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e84b-f580-4d06-9724-9f01c22dd5a6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.496729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.497340 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.497612 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.497885 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.507517 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.509060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.517407 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1400/2798] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:05.518787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1399/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:05.521734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.588019 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e657e2-ecc2-4ae7-b462-e4369c682d78 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.592902 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.593506 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.593781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.594048 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.594676 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.596588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.618709 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1401/2800] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:05.623327 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.633926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e09b-204a-44e6-a6e3-2107285a7fc1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.639055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.639650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.639951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.640219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.640961 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.642773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.654092 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1400/2801] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:05.658144 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.671127 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93165-c22d-4d0a-8c97-c57422d2dc16 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.676553 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.677319 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.677598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.677877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.678545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.680181 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baa75-a941-4d13-adeb-343fc5646f68 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.690621 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1402/2802] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:05.694970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.705688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e47c89-48e2-487b-8408-1b745af6e2b0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.710968 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.711654 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.711933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.712206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] PATH_INFO: `/v3/projects/0e55b343954b46d189b046b712ca5ee8/users/492780727ab9463b8879ae83c18f4fca/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.728244 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e55b343954b46d189b046b712ca5ee8, user_id=492780727ab9463b8879ae83c18f4fca, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.730951 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.745272 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1401/2803] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:05 2022] PUT /identity/v3/projects/0e55b343954b46d189b046b712ca5ee8/users/492780727ab9463b8879ae83c18f4fca/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:05.756782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.757490 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.757948 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.789323 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] MFA Rules not processed for user `492780727ab9463b8879ae83c18f4fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:05.790562 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.804712 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.806466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.847035 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:05.874114 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1403/2804] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:05.877858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfabd39-d3f0-4bb6-a163-9848548d8e7c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.882853 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.883493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.883771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.884044 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] PATH_INFO: `/v3/projects/d1ad540aeada4263b24f5316bb14119d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.885454 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ad540aeada4263b24f5316bb14119d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.885952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.887315 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.887437 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.921496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:05.938218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ad540aeada4263b24f5316bb14119d', 'request_id': 'req-248342b3-373a-44da-8d62-dd50889e2988'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.944292 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ad540aeada4263b24f5316bb14119d', 'request_id': 'req-248342b3-373a-44da-8d62-dd50889e2988'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.948176 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98290589-4757-454e-ab37-2cba4a2da019 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.953585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ad540aeada4263b24f5316bb14119d', 'request_id': 'req-248342b3-373a-44da-8d62-dd50889e2988'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.966118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] The token cache is being invalidate because project d1ad540aeada4263b24f5316bb14119d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:05.966413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.967902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-248342b3-373a-44da-8d62-dd50889e2988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.969690 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1402/2805] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:05 2022] DELETE /identity/v3/projects/d1ad540aeada4263b24f5316bb14119d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:05.975064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5125-2007-4dad-a3ee-881938eeeccd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.975349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5125-2007-4dad-a3ee-881938eeeccd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.975754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5125-2007-4dad-a3ee-881938eeeccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.995290 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-874a5125-2007-4dad-a3ee-881938eeeccd None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:05.996764 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-874a5125-2007-4dad-a3ee-881938eeeccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:05.999959 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.000584 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.000919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.001193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.002943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.057773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1403/2806] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:06.062492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.064097 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.065416 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f2909-0945-4773-a994-51557890b389 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.065818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f2909-0945-4773-a994-51557890b389 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.066101 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f2909-0945-4773-a994-51557890b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.073545 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1404/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:06.086225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c0f2909-0945-4773-a994-51557890b389 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.087440 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c0f2909-0945-4773-a994-51557890b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.092718 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.094111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.095938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1404/2808] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:06.100773 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f2909-0945-4773-a994-51557890b389 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.108771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92a20-3c0d-474c-b853-afe3b52b7977 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.110215 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f2909-0945-4773-a994-51557890b389 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.113372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.114001 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.114301 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.115368 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] PATH_INFO: `/v3/users/492780727ab9463b8879ae83c18f4fca` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.115813 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.116468 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.116601 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492780727ab9463b8879ae83c18f4fca)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.116854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.117141 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.117767 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:06.118068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.118444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.119635 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.131279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1405/2809] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:32:06.135435 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.145028 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec872-041b-4db9-9b18-d101d1a68b44 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.150135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.150701 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.151001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.151246 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.151857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.153916 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.166868 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492780727ab9463b8879ae83c18f4fca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.168793 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.176571 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492780727ab9463b8879ae83c18f4fca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.182992 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1406/2810] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:06.186990 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.187207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492780727ab9463b8879ae83c18f4fca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.187869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492780727ab9463b8879ae83c18f4fca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.188511 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9588cdc6-01d1-475d-904a-fa0b7cf444c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492780727ab9463b8879ae83c18f4fca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.209193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1405/2811] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:06 2022] DELETE /identity/v3/users/492780727ab9463b8879ae83c18f4fca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:06.213630 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.214256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.214256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.233527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.234739 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.256970 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9f0c-0c69-4b7e-bf76-45b7cd29fa4a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.275571 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.297389 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1406/2812] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:06.308409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.309854 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.318067 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.319035 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.319312 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.319576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.320192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.322118 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.346281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1407/2813] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:06.347583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.349811 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.361743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4e376-bfaf-4570-8e02-5679e66dadc7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.367399 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.368004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.368279 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.368547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.369220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.369781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf7c3a-6339-46dc-be5f-df0104e24e6d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.370878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.373531 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.374163 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.374445 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.374714 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.381222 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1408/2814] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:06.384340 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.384884 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.385764 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.394820 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f9e3-35a4-42ab-8319-d84a5689152b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.395350 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1407/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:06.400721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.401336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.401611 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.401878 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.402504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.404105 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e878d81-2e9b-4f9e-87f4-9ff7fbd504a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.420216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1409/2816] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:06.424331 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.434602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40815d2-55cb-4390-badd-b0da9e50efbe service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.439417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.440139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.440415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.440706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] PATH_INFO: `/v3/projects/5dd8e648e0484910a84751add5bbc88e/users/96bc86599d574e388a71d11d81b1e690/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.456425 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd8e648e0484910a84751add5bbc88e, user_id=96bc86599d574e388a71d11d81b1e690, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.459910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.473540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1408/2817] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:06 2022] PUT /identity/v3/projects/5dd8e648e0484910a84751add5bbc88e/users/96bc86599d574e388a71d11d81b1e690/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:06.484743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.485023 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.485331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.516084 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] MFA Rules not processed for user `96bc86599d574e388a71d11d81b1e690`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.517432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.593463 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1410/2818] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:06.605736 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.607797 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.654889 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.669610 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58365-8c74-433c-a6c4-13b9a728d004 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.674024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.674656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.674938 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.675228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.684031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.685493 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402241a9-c1c1-4c30-869b-e998494cd177 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.695950 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1409/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:06.697801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.699242 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.811012 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a11c-6cf8-4cc4-9d7f-b23ccbdd3a51 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.816310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.817038 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.817317 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.818007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] PATH_INFO: `/v3/projects/0e55b343954b46d189b046b712ca5ee8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.819227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e55b343954b46d189b046b712ca5ee8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.821182 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.849836 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.880566 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e55b343954b46d189b046b712ca5ee8', 'request_id': 'req-44f3f683-aad4-4ec9-94be-23bd2b261d21'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.889964 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e55b343954b46d189b046b712ca5ee8', 'request_id': 'req-44f3f683-aad4-4ec9-94be-23bd2b261d21'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.898912 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e55b343954b46d189b046b712ca5ee8', 'request_id': 'req-44f3f683-aad4-4ec9-94be-23bd2b261d21'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.914001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] The token cache is being invalidate because project 0e55b343954b46d189b046b712ca5ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:06.914410 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.915110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44f3f683-aad4-4ec9-94be-23bd2b261d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.916627 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1411/2820] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:06 2022] DELETE /identity/v3/projects/0e55b343954b46d189b046b712ca5ee8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:06.921620 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.921904 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.922174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.943508 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.944742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:07.015749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1410/2821] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:07.024342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.024633 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.024938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.049493 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:07.050771 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:07.063430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1412/2822] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:07.068750 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.080005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060077-7fb9-44f2-b50f-8d862e5ec1c6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.086587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.087284 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.087767 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.088124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.089353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:07.089771 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.091474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.110456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1411/2823] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:07.112363 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.123281 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bdff1-0867-4ac9-856c-6b6d6243b9d8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.132406 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.133181 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.133527 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.133865 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.134569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.136592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.179954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1413/2824] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:07.184454 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.195939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c9d3-23be-4bea-9afb-bab5dde8fae6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.257212 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.257918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.258086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.258363 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.259024 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.260969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.281681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1412/2825] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:07.285699 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.297166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376462-82c8-47aa-b71d-2232fff80458 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.301927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.302626 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.302900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.303161 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.303793 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.305403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.316006 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1414/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:07.320161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.331409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25a6e-bf92-4803-8357-ba14ab84e1fc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.337139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.337741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.338016 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.338285 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.338923 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.340517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0d9b-7ae7-434a-9e30-c453c3b86d6c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.351752 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1413/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:07.355891 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.366603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c7ddb-53d7-4e3f-9706-6f8802dd5481 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.371548 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.372208 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.372511 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.372826 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] PATH_INFO: `/v3/projects/4277dac2dbd2476eb61e6e9c1d261134/users/d05b57b98b4c43519d18ca6ca55484d4/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.388079 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4277dac2dbd2476eb61e6e9c1d261134, user_id=d05b57b98b4c43519d18ca6ca55484d4, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.390901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.405389 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1415/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:07 2022] PUT /identity/v3/projects/4277dac2dbd2476eb61e6e9c1d261134/users/d05b57b98b4c43519d18ca6ca55484d4/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:07.417694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.417960 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.418321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.447086 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] MFA Rules not processed for user `d05b57b98b4c43519d18ca6ca55484d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:07.448297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:07.489220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:07.514749 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1414/2829] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:07.519055 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.590688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90024-6233-4ee4-8a55-d7ff57379d86 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.595395 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.595998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.596271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.596535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.597195 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.599133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.627165 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1416/2830] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:07.632384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.643409 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750c700-85c1-4773-aecb-59904077bd4e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.703199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.703721 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.704002 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.704274 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.704943 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.706942 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.730112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1415/2831] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:07.734347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.744769 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41daa-b7d2-4953-afa6-926c1010e729 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.749349 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.749940 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.750217 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.750487 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.751126 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.752860 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.765062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1417/2832] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:07.768784 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.779492 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76ad-448b-49d8-97ae-546235bbf7eb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.784099 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.784742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.785003 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.785270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.785905 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.787494 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88beada-e3b0-4f08-8149-169471e16960 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.797220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1416/2833] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:07.801582 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:07.812751 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2032-2563-4378-8a30-5ee65782aa6a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.818103 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.818788 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.819061 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.819331 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] PATH_INFO: `/v3/projects/91f6c462d5d84b92bf13003368f83d8f/users/caab1499e9ac49128073dda8d8452d8e/roles/f2aede2952884054a38514133b316bb1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.834065 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f6c462d5d84b92bf13003368f83d8f, user_id=caab1499e9ac49128073dda8d8452d8e, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.836782 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.839825 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:07.851229 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1418/2834] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:07 2022] PUT /identity/v3/projects/91f6c462d5d84b92bf13003368f83d8f/users/caab1499e9ac49128073dda8d8452d8e/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:07.918358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.918642 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.918919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.948372 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] MFA Rules not processed for user `caab1499e9ac49128073dda8d8452d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:07.949634 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:08.016154 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1417/2835] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:08.021097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.086049 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489bddb-42df-4dda-9401-6a43a97295a6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.093307 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.093933 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.094213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.094480 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.095108 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.097060 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.125293 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1419/2836] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:08 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:08.129386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.140811 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda9db-b9a1-4f38-8047-a3626ce930e1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.187698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:08.199349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.199962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.200241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.200540 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.201256 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.203541 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.229296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1418/2837] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:08 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:08.233549 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.244537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127972aa-4dd3-4a99-9779-741921b30553 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.249054 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.249649 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.249926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.250191 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.250823 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.252380 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.266555 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1420/2838] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:08.270654 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.281444 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4fa56-33d4-435a-bf65-bbb01a73cfe7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.286087 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.286834 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.287116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.287390 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] PATH_INFO: `/v3/projects/3a41d00134684877af91f4b18ef18897/users/feaf2b89a72b462e8663f320ddbed6bd/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.302421 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a41d00134684877af91f4b18ef18897, user_id=feaf2b89a72b462e8663f320ddbed6bd, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.305129 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.317970 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1419/2839] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:08 2022] PUT /identity/v3/projects/3a41d00134684877af91f4b18ef18897/users/feaf2b89a72b462e8663f320ddbed6bd/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:08.321902 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.332110 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2e6d-b869-46e4-ad8e-76a3cff207ba admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.389620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.390225 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.390504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.390775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.391403 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.393037 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba2487-4385-4f58-89b5-fc8f426789df admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.407650 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1421/2840] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:08.409221 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.419873 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4652-f0a1-4e31-8eea-0d82108d720c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.424463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.425159 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.425436 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.425710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] PATH_INFO: `/v3/projects/3a41d00134684877af91f4b18ef18897/users/feaf2b89a72b462e8663f320ddbed6bd/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.427823 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a41d00134684877af91f4b18ef18897, user_id=feaf2b89a72b462e8663f320ddbed6bd, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.430528 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.441225 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1420/2841] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:08 2022] PUT /identity/v3/projects/3a41d00134684877af91f4b18ef18897/users/feaf2b89a72b462e8663f320ddbed6bd/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:08.452091 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.452377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.452670 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.483470 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] MFA Rules not processed for user `feaf2b89a72b462e8663f320ddbed6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:08.484734 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:08.536414 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:08.557664 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1422/2842] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:08.569975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.572708 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:08.637869 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebb26d-5cf8-4ec3-b8c9-cfafdd189db3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.641510 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.642112 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.642387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.642652 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.700240 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.701703 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.711113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1421/2843] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:10.221386 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:10.232815 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1e57c-62aa-4d1a-ae64-2ee618508d9e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:10.236284 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:10.236920 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:10.237192 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:10.237459 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:10.296342 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:10.297898 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:10.306816 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1423/2844] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:10.866800 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:10.875615 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867cdeb-0fe2-4396-9dbc-2430d2759d33 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:10.879359 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:10.880590 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:10.880903 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:10.881174 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:10.890844 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:10.892278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded53002-f780-4305-b366-f00aadc64bac service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:10.901710 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1422/2845] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:14.772072 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:14.839206 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a4a8-c9ff-4b79-8573-4f5c4f1a7c37 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:14.843750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:14.844377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.844679 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.844941 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] PATH_INFO: `/v3/users/d05b57b98b4c43519d18ca6ca55484d4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.846064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05b57b98b4c43519d18ca6ca55484d4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.847948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.894846 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05b57b98b4c43519d18ca6ca55484d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:14.903943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05b57b98b4c43519d18ca6ca55484d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:14.904851 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05b57b98b4c43519d18ca6ca55484d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:14.905523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05b57b98b4c43519d18ca6ca55484d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:14.913559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05b57b98b4c43519d18ca6ca55484d4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:14.931564 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1424/2846] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:14 2022] DELETE /identity/v3/users/d05b57b98b4c43519d18ca6ca55484d4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:14.935975 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.936438 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.936535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.956111 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:14.957272 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.000481 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.021094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1423/2847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:15.035336 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.037382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.049428 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.098841 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222ce16-f215-45fb-a860-1509013abba0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:15.102817 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:15.103413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.103721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.103994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.113446 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:15.115556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:15.125901 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1425/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:15.411312 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.417380 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.428698 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20a80d-b0bb-414f-8e22-1fe32f403d51 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:15.439157 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:15.439809 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.440085 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.440347 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] PATH_INFO: `/v3/projects/4277dac2dbd2476eb61e6e9c1d261134` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.441675 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4277dac2dbd2476eb61e6e9c1d261134)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:15.444148 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:15.492782 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4277dac2dbd2476eb61e6e9c1d261134', 'request_id': 'req-318a76c2-1cfd-4c52-a4bf-09591082b5d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.498233 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4277dac2dbd2476eb61e6e9c1d261134', 'request_id': 'req-318a76c2-1cfd-4c52-a4bf-09591082b5d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.507276 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4277dac2dbd2476eb61e6e9c1d261134', 'request_id': 'req-318a76c2-1cfd-4c52-a4bf-09591082b5d7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.518235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] The token cache is being invalidate because project 4277dac2dbd2476eb61e6e9c1d261134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:15.518517 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.519128 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.520593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1424/2849] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:15 2022] DELETE /identity/v3/projects/4277dac2dbd2476eb61e6e9c1d261134 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:15.525556 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.535600 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec61c-64e9-4a20-b03d-4eeb7e60af19 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:15.599640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:15.600478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.600785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.601051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] PATH_INFO: `/v3/users/caab1499e9ac49128073dda8d8452d8e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.602177 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caab1499e9ac49128073dda8d8452d8e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:15.604150 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:15.655569 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caab1499e9ac49128073dda8d8452d8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.663607 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caab1499e9ac49128073dda8d8452d8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.664274 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caab1499e9ac49128073dda8d8452d8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.664895 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caab1499e9ac49128073dda8d8452d8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.671801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caab1499e9ac49128073dda8d8452d8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.689642 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1426/2850] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:15 2022] DELETE /identity/v3/users/caab1499e9ac49128073dda8d8452d8e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:15.966104 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.967673 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.981690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a76c2-1cfd-4c52-a4bf-09591082b5d7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.044702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.045252 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.045534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.045803 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] PATH_INFO: `/v3/projects/91f6c462d5d84b92bf13003368f83d8f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.046911 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f6c462d5d84b92bf13003368f83d8f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.048866 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.096045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f6c462d5d84b92bf13003368f83d8f', 'request_id': 'req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.102302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f6c462d5d84b92bf13003368f83d8f', 'request_id': 'req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.109921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f6c462d5d84b92bf13003368f83d8f', 'request_id': 'req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.117617 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:16.122468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] The token cache is being invalidate because project 91f6c462d5d84b92bf13003368f83d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:16.122934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.123993 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.125554 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1425/2851] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:15 2022] DELETE /identity/v3/projects/91f6c462d5d84b92bf13003368f83d8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:16.129775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.131432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:16.144007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3534c6-3661-4612-9ed7-d1435fb5fcb5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.175248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:16.205568 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.206199 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.206476 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.206743 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] PATH_INFO: `/v3/users/feaf2b89a72b462e8663f320ddbed6bd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.207839 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feaf2b89a72b462e8663f320ddbed6bd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.210343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.260130 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feaf2b89a72b462e8663f320ddbed6bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.268840 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feaf2b89a72b462e8663f320ddbed6bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.269552 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feaf2b89a72b462e8663f320ddbed6bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.270218 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feaf2b89a72b462e8663f320ddbed6bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.279039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feaf2b89a72b462e8663f320ddbed6bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.296818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1427/2852] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:16 2022] DELETE /identity/v3/users/feaf2b89a72b462e8663f320ddbed6bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:16.580199 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.584160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:16.595277 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72ec9-fa69-4d4d-af6d-7fbeaaa14692 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.655534 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.656177 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.656463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.656779 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] PATH_INFO: `/v3/projects/3a41d00134684877af91f4b18ef18897` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.657915 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a41d00134684877af91f4b18ef18897)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.659830 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.713991 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a41d00134684877af91f4b18ef18897', 'request_id': 'req-30ef3258-b02d-4438-acd6-eb1b38cf69e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.719397 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a41d00134684877af91f4b18ef18897', 'request_id': 'req-30ef3258-b02d-4438-acd6-eb1b38cf69e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.727242 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a41d00134684877af91f4b18ef18897', 'request_id': 'req-30ef3258-b02d-4438-acd6-eb1b38cf69e7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.738607 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] The token cache is being invalidate because project 3a41d00134684877af91f4b18ef18897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:16.738894 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.739519 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-30ef3258-b02d-4438-acd6-eb1b38cf69e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.741226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1426/2853] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:16 2022] DELETE /identity/v3/projects/3a41d00134684877af91f4b18ef18897 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:26.293216 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:26.735561 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:34.819390 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:34.820847 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:34.834024 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004b20-b500-47fb-8a1c-6b8845cbb555 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:34.894220 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:34.894854 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:34.895133 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:34.895402 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] PATH_INFO: `/v3/users/96bc86599d574e388a71d11d81b1e690` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:34.896541 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bc86599d574e388a71d11d81b1e690)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:34.898484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:34.943838 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bc86599d574e388a71d11d81b1e690'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:34.952170 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bc86599d574e388a71d11d81b1e690'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:34.952922 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bc86599d574e388a71d11d81b1e690'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:34.953520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bc86599d574e388a71d11d81b1e690'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:34.960368 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bc86599d574e388a71d11d81b1e690'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:34.990523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1428/2854] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:34 2022] DELETE /identity/v3/users/96bc86599d574e388a71d11d81b1e690 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:34.995704 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:34.996226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:34.996226 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.020907 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:35.022376 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.086969 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1427/2855] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:35.096971 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.098417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.160578 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152172-4cc2-4ab9-a2ff-1418ed77052d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.166791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.167430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.167707 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.167972 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.177547 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.180001 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15295ad-4fe8-40ee-80a1-dbf3a5712ae2 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.196098 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1429/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:35.518289 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.520711 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.537921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe609a-3326-4957-bca3-fb965be3e3f2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.543392 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.544039 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.544316 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.544587 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] PATH_INFO: `/v3/projects/5dd8e648e0484910a84751add5bbc88e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.545790 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd8e648e0484910a84751add5bbc88e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.547781 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.601729 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd8e648e0484910a84751add5bbc88e', 'request_id': 'req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:35.610386 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd8e648e0484910a84751add5bbc88e', 'request_id': 'req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:35.618996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd8e648e0484910a84751add5bbc88e', 'request_id': 'req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:35.632602 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] The token cache is being invalidate because project 5dd8e648e0484910a84751add5bbc88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:35.632918 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:35.633593 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5caa10c7-a34a-49a6-b3db-e31ae68eccf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:35.635342 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1428/2857] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:35 2022] DELETE /identity/v3/projects/5dd8e648e0484910a84751add5bbc88e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:35.640305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.640587 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.640896 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.661994 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:35.663413 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.683609 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:35.737074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1430/2858] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:35.745005 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.745292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.745595 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.767945 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:35.769172 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.778029 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1429/2859] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:35.782381 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.792681 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7fa5f-f8d6-4e49-a66d-ff4eacd22224 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.797213 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.797807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.798086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.798358 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.799004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:35.799309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.800934 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.812357 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1431/2860] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:35.816897 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.826878 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3749b0-f264-49a2-a95d-dbd07b35fe33 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.831535 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.832334 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.832679 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.833072 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.833690 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.835588 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.862827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1430/2861] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:35 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:35.867077 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.877471 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def592f-32fd-4c3b-9978-fcb619ad1b34 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.934729 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.935330 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.935606 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.935877 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.936497 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.938432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.958857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1432/2862] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:35 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:35.963195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:35.974050 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647437b-a5b4-4d77-8dd5-57a2eb43fb3c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:35.979164 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:35.979754 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:35.980031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:35.980297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.980961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:35.982804 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:35.992941 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1431/2863] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:35.997639 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:36.007533 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b58f4-477b-4615-9b57-14c8db07779a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:36.012117 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:36.012728 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.013004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.013271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.013957 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:36.015531 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8670b9a-68d9-4f9d-a9c4-6295861aee3b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:36.026051 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1433/2864] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:36.030429 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:36.041269 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeff26-fde0-4f8e-98a5-2c937a047b59 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:36.045851 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:36.046498 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.046774 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.047045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] PATH_INFO: `/v3/projects/48553876fa9348e3967047783e123806/users/6f273cc2df4441eda5d71d76c318a1fb/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.062197 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48553876fa9348e3967047783e123806, user_id=6f273cc2df4441eda5d71d76c318a1fb, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:36.064934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:36.079214 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1432/2865] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:36 2022] PUT /identity/v3/projects/48553876fa9348e3967047783e123806/users/6f273cc2df4441eda5d71d76c318a1fb/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:36.090087 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b81c-289b-471c-93cb-10bd3623a2c7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.090366 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b81c-289b-471c-93cb-10bd3623a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.090640 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b81c-289b-471c-93cb-10bd3623a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.118871 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eb14b81c-289b-471c-93cb-10bd3623a2c7 None None] MFA Rules not processed for user `6f273cc2df4441eda5d71d76c318a1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:36.120063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb14b81c-289b-471c-93cb-10bd3623a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:36.183583 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1434/2866] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:36.193976 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:36.195646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:36.217300 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:36.253321 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef44-c576-4bf2-a244-00d9ae0b0b34 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:36.257296 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95fe28df0f1e4f9ca978a912bbffe4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:36.258043 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.258524 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.259404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.268762 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:36.270179 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:36.279495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1433/2867] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:37.686116 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:37.686688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:37.686688 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:37.706849 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] MFA Rules not processed for user `6f273cc2df4441eda5d71d76c318a1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:37.708171 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:37.715538 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1435/2868] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:37.750984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:37.752396 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:37.808523 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24ad2-98f3-4f5c-9445-3f2f7c70a2b9 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:37.812069 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:37.812681 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:37.812962 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:37.813228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:37.814926 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:37.883627 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:37.885182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:37.895952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1434/2869] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:38.320585 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:38.322634 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.327773 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:38.329188 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.336329 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:38.387685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d864-c128-4dc0-97d6-d8f588584798 service glance] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:38.391293 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:38.391934 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:38.392208 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:38.392474 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:38.394228 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.394615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43c690-5816-406d-b6f1-2caad743333f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:38.399537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:38.400963 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:38.401335 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:38.401721 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:38.403456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.408235 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:38.409692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:38.420787 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:38.421576 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1435/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:38.425610 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b474d-02d1-4fe7-b9fe-1dbe855887fd service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:38.437807 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1436/2871] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:40.263246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:40.272984 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4f12-a94c-4a35-b9a9-351ecf809e28 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:40.277501 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:40.278113 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:40.278387 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:40.278651 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:40.280426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:40.286879 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:40.293015 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:40.294468 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:40.303996 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1436/2872] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:48.432620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=27 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:50.299670 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:54.265207 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c583e4-af95-4a84-9043-432e462586c6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:54.265691 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c583e4-af95-4a84-9043-432e462586c6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:54.265809 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c583e4-af95-4a84-9043-432e462586c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:54.314309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d6c583e4-af95-4a84-9043-432e462586c6 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:54.315514 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d6c583e4-af95-4a84-9043-432e462586c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:54.379750 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1437/2873] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:32:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:54.426139 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:54.427581 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:54.518178 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9c42-7571-4da2-b3ef-c283ee405d5c service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:54.523241 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:54.523839 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:54.524116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:54.524385 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:54.533095 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:54.534662 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:54.543585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1437/2874] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:55.036658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16926-b080-4420-8e18-dcbe654eacc9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.036965 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16926-b080-4420-8e18-dcbe654eacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.037238 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16926-b080-4420-8e18-dcbe654eacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.056717 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-65b16926-b080-4420-8e18-dcbe654eacc9 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:55.057915 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65b16926-b080-4420-8e18-dcbe654eacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:55.065576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1438/2875] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:55.077836 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:55.088243 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6144cb9-3e2b-493c-9108-654126e17b7c service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:55.094417 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:55.094997 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.095270 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.095537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.103648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:55.105248 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:55.114456 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1438/2876] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:55.324432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527552c1-3c2e-411d-b7ff-2415edc481c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.324917 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527552c1-3c2e-411d-b7ff-2415edc481c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.325064 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527552c1-3c2e-411d-b7ff-2415edc481c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.344894 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-527552c1-3c2e-411d-b7ff-2415edc481c2 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:55.346085 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-527552c1-3c2e-411d-b7ff-2415edc481c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:55.353267 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1439/2877] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:55.365222 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:55.375765 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aefd3a-1b7f-448a-8fe8-c43fee4ddb71 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:55.380668 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:55.381267 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.381537 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.381827 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.390785 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:55.392520 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:55.400758 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1439/2878] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:55.715669 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.715956 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.716232 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.737057 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:55.738271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:55.745465 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1440/2879] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:55.757361 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:55.768317 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a3ab-dd9e-428b-a11e-9a6f299eedaf service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:55.773384 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:55.773971 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:55.774246 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:55.774513 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:55.782887 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:55.784453 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c728-e404-40ba-bba0-96868d538954 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:55.792245 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1440/2880] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:32:57.863504 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:57.925742 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de176a-10ad-4156-bddf-e4a10cd21efa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:57.930178 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:57.930800 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:57.931076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:57.931347 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] PATH_INFO: `/v3/users/6f273cc2df4441eda5d71d76c318a1fb` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:57.932496 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f273cc2df4441eda5d71d76c318a1fb)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:57.934442 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:57.979848 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f273cc2df4441eda5d71d76c318a1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:57.987449 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f273cc2df4441eda5d71d76c318a1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:57.988097 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f273cc2df4441eda5d71d76c318a1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:57.988730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f273cc2df4441eda5d71d76c318a1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:57.989982 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:57.997955 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f273cc2df4441eda5d71d76c318a1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.016310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1441/2881] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:57 2022] DELETE /identity/v3/users/6f273cc2df4441eda5d71d76c318a1fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:58.020849 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.021320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.021422 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.039737 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:58.040973 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.100136 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1441/2882] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:58.110488 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.111900 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.170778 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d0d6-d745-4303-80ec-90f6aaa61eb4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.174467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.175066 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.175338 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.175603 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.184334 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.186314 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507957-f999-4b73-87b5-61e626c3b6e7 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.195899 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1442/2883] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:58.366901 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.368320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.381286 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65acad-77c9-4a74-b44d-baf3f728d5ed None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.386006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.386636 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.386910 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.387291 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] PATH_INFO: `/v3/projects/48553876fa9348e3967047783e123806` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.388415 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48553876fa9348e3967047783e123806)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.390994 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.421402 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:58.439364 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48553876fa9348e3967047783e123806', 'request_id': 'req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.445006 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48553876fa9348e3967047783e123806', 'request_id': 'req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.452348 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48553876fa9348e3967047783e123806', 'request_id': 'req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.463250 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] The token cache is being invalidate because project 48553876fa9348e3967047783e123806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:58.463536 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.464160 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-34e7ef45-536d-4c8d-b7e6-e7372a3c4802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:58.465685 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1442/2884] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:58 2022] DELETE /identity/v3/projects/48553876fa9348e3967047783e123806 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:58.470783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.471074 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.471382 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.491062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:58.492269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.552812 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1443/2885] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:58.561579 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.561877 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.562151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.582333 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:58.583529 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.591336 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1443/2886] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:58.595962 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.605523 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b0e98-40ca-4efa-9407-03cf8cadf254 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.610866 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.611377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.611652 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.611919 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.612559 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:58.612887 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.614467 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.626166 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1444/2887] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:58.630405 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.639646 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0585f-942e-4ba8-b3db-59a88045ceac None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.644231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.644856 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.645135 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.645404 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.646063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.647967 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.675497 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1444/2888] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:58.679580 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.689857 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5058ba-cf0b-4c8e-9b22-386bf6670720 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.747052 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.747658 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.747938 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.748212 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.748876 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.750783 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.759472 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:58.772254 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1445/2889] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:58.776369 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.787427 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33b16-49bf-4e59-985e-4ad98bbd6e9e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.792410 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.793074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.793378 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.793648 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.794288 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.796598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.806946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1445/2890] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:58.810671 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.820466 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a2569-1a27-4d43-9b55-255d7ae2470b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.825179 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.825766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.826046 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.826319 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.827099 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.828696 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfdba7-2a3e-43a7-a2fc-3889a99fe7cf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.839039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1446/2891] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:58.843382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.853216 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78071-0a4a-4fbc-b817-170e1efa9e89 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:58.858738 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:58.859314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.859586 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.859883 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] PATH_INFO: `/v3/projects/358ce4a9adb74749b14d661964182ce2/users/7024e4b1c9a546a6b25e83eed2035f4a/roles/f2aede2952884054a38514133b316bb1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.874302 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358ce4a9adb74749b14d661964182ce2, user_id=7024e4b1c9a546a6b25e83eed2035f4a, role_id=f2aede2952884054a38514133b316bb1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:58.876990 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:58.889592 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1446/2892] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:58 2022] PUT /identity/v3/projects/358ce4a9adb74749b14d661964182ce2/users/7024e4b1c9a546a6b25e83eed2035f4a/roles/f2aede2952884054a38514133b316bb1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:58.894584 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76232-6cab-4278-89dd-d287b224b304 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:58.895039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76232-6cab-4278-89dd-d287b224b304 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:58.895135 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76232-6cab-4278-89dd-d287b224b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:58.914576 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-42a76232-6cab-4278-89dd-d287b224b304 None None] MFA Rules not processed for user `c7afcca3526940e6b32f29d6912ef770`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:58.915766 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-42a76232-6cab-4278-89dd-d287b224b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:58.977461 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1447/2893] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:58.987608 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:58.989320 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:59.046063 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37373dc-e651-465b-ae20-df79cc1fc590 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:59.049696 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:59.050292 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:59.050565 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:59.050831 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:59.059598 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:59.061061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:59.070207 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1447/2894] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:03.017417 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.018007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.018007 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.052592 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] MFA Rules not processed for user `7024e4b1c9a546a6b25e83eed2035f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:03.054169 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:03.125692 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1448/2895] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:03.130200 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.141349 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ab0d-441f-476e-92ec-29dcd33b5fea service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.146527 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.147182 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.147461 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.147728 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.148360 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.150297 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.179549 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1448/2896] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:03 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:03.183791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.195231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c0aa3-8fe6-46e6-9284-7adf6d26b768 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.255068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.255677 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.255954 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.256219 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.256882 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.258858 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.277227 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:03.282998 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1449/2897] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:03 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:03.287061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.297789 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423af4f-d373-4aee-b874-fe6a6ed1e738 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.302329 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.302919 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.303192 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.303455 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.304078 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.305699 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.317616 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1449/2898] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:03.322043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.333543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d873016-0eb1-40ef-ad77-a3edfdf008b3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.338344 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.338997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.339271 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.339644 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] PATH_INFO: `/v3/projects/0484b5182f684cfface7e89c16bf7e62/users/001b7b669cc041969ff9b80d8c2998d5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.357308 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0484b5182f684cfface7e89c16bf7e62, user_id=001b7b669cc041969ff9b80d8c2998d5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.360755 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.374725 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1450/2899] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:03 2022] PUT /identity/v3/projects/0484b5182f684cfface7e89c16bf7e62/users/001b7b669cc041969ff9b80d8c2998d5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:03.383995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.390074 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95e1c-1efc-4cdc-ada2-815baf9d6fb9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.407439 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:03.454045 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.454666 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.454949 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.455220 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.455863 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.457572 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922f85-c7d1-4d68-b923-fdb804110899 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.469081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1450/2900] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:03.473484 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.485043 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe817-77ec-4df0-8438-4cc172b8998a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.490068 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.490808 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.491160 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.491502 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] PATH_INFO: `/v3/projects/0484b5182f684cfface7e89c16bf7e62/users/001b7b669cc041969ff9b80d8c2998d5/roles/c263d8337db14b7e938c9a63cd631fad` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.493604 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0484b5182f684cfface7e89c16bf7e62, user_id=001b7b669cc041969ff9b80d8c2998d5, role_id=c263d8337db14b7e938c9a63cd631fad)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.496269 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.508016 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1451/2901] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:03 2022] PUT /identity/v3/projects/0484b5182f684cfface7e89c16bf7e62/users/001b7b669cc041969ff9b80d8c2998d5/roles/c263d8337db14b7e938c9a63cd631fad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:08.022555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142f50-7f42-4074-b485-52593520a66c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:08.023089 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142f50-7f42-4074-b485-52593520a66c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:08.023193 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142f50-7f42-4074-b485-52593520a66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:08.059459 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e8142f50-7f42-4074-b485-52593520a66c None None] MFA Rules not processed for user `001b7b669cc041969ff9b80d8c2998d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:08.060995 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8142f50-7f42-4074-b485-52593520a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:08.140195 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1451/2902] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:33:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:08.152831 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:08.156152 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:08.229843 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815993-df49-4b3d-b09f-adbcb448f0e6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:08.234062 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac10759b62640d08ddbd86d1972b54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:08.234674 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:08.234948 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:08.235224 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:08.308675 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:08.310309 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:08.322432 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1452/2903] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:08.457103 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b500-14f9-4268-92db-12e54a7a6ed4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:08.457478 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b500-14f9-4268-92db-12e54a7a6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:08.457817 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b500-14f9-4268-92db-12e54a7a6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:08.479850 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ce28b500-14f9-4268-92db-12e54a7a6ed4 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:08.481194 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ce28b500-14f9-4268-92db-12e54a7a6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:08.539090 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1452/2904] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:08.551039 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:08.552411 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:08.627781 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741562ad-0625-46dd-bb37-d49e7a9e05a6 service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:08.632835 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:08.633448 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:08.633726 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:08.633997 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:08.642543 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:08.644119 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec16bd8-0529-47be-86d9-b6ecf183a48c service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:08.652058 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1453/2905] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:33:17.038203 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.038706 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.038819 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.058734 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] MFA Rules not processed for user `7024e4b1c9a546a6b25e83eed2035f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.059939 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.067742 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1453/2906] 10.222.0.26 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.648867 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.899601 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.899943 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.900266 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.920537 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.921791 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.929034 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1454/2907] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.943116 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.956170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0c106-6095-4446-9ade-c20a0288fd7b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.961124 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.962358 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.962638 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.962909 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.971452 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.973094 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.981399 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1454/2908] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:33:28.914926 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:28.978106 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:42.730377 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:42.783967 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668a1c-fa8f-4d92-979e-8e3d1e1eab3a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.787544 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba51537c644043ae8c31655ad1b6426c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.788137 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.788418 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.788710 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.797927 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.799350 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.808503 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1455/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:52.804478 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=26 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:02.499353 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:02.501117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:02.625314 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55654fc-f532-4892-8c35-a1c0d6636e68 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:02.630956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbdc6b9326be4f509f1c085d13187bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:02.631583 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:02.631860 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:02.632130 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:02.633952 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:02.649231 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:02.651328 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a767f5-cb76-4694-b1b8-09222742a1ad service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:02.666125 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1455/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:09.535775 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:09.537305 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:09.605818 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ccf0-8b06-42f8-8a3b-6ac8bba82cc3 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:09.611115 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:09.611714 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:09.611989 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:09.612256 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:09.614004 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:09.625546 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:09.627162 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:09.639189 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1456/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:10.411463 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:10.411956 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:10.412061 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:10.431694 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] MFA Rules not processed for user `85122d5f39df41b08d41c51ae931b3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:10.432946 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:10.440843 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1456/2912] 10.222.0.26 () {58 vars in 967 bytes} [Mon Aug 8 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:10.483310 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:10.494810 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9549ce-3e44-43f7-b1eb-4577dabe5b44 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:10.500456 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea9dc686de47a3a860483a746025ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:10.501086 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:10.501364 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:10.501630 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:10.509724 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:10.511286 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:10.519801 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1457/2913] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Aug 8 02:36:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:16.830426 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:16.900026 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c461ae-3d38-4cbb-a266-0b0d3265d826 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:16.905280 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:16.905912 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:16.906190 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:16.906457 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] PATH_INFO: `/v3/users/7024e4b1c9a546a6b25e83eed2035f4a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:16.907555 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7024e4b1c9a546a6b25e83eed2035f4a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:16.909502 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:16.955151 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7024e4b1c9a546a6b25e83eed2035f4a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:16.962702 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7024e4b1c9a546a6b25e83eed2035f4a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:16.970503 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7024e4b1c9a546a6b25e83eed2035f4a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:16.971170 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7024e4b1c9a546a6b25e83eed2035f4a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:16.971768 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7024e4b1c9a546a6b25e83eed2035f4a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:16.984345 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:16.990495 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1457/2914] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:36:16 2022] DELETE /identity/v3/users/7024e4b1c9a546a6b25e83eed2035f4a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:17.166231 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:17.179076 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526540a8-2c8a-4ec5-b30f-1ab1b468309c service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:17.238280 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:17.238936 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:17.239248 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:17.239520 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] PATH_INFO: `/v3/projects/358ce4a9adb74749b14d661964182ce2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:17.240676 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358ce4a9adb74749b14d661964182ce2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:17.242620 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:17.289287 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358ce4a9adb74749b14d661964182ce2', 'request_id': 'req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.294883 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358ce4a9adb74749b14d661964182ce2', 'request_id': 'req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.302017 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358ce4a9adb74749b14d661964182ce2', 'request_id': 'req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.313430 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] The token cache is being invalidate because project 358ce4a9adb74749b14d661964182ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:36:17.313711 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.314328 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.315785 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1458/2915] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:36:17 2022] DELETE /identity/v3/projects/358ce4a9adb74749b14d661964182ce2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:17.319818 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:17.321278 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:17.334692 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ceeb-b334-43be-9acb-fefa7ade63d9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:17.390766 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:17.391382 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:17.391656 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:17.391921 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] PATH_INFO: `/v3/users/001b7b669cc041969ff9b80d8c2998d5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:17.393065 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=001b7b669cc041969ff9b80d8c2998d5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:17.394961 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:17.444585 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001b7b669cc041969ff9b80d8c2998d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.453081 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001b7b669cc041969ff9b80d8c2998d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.460070 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001b7b669cc041969ff9b80d8c2998d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.460807 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001b7b669cc041969ff9b80d8c2998d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.461499 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001b7b669cc041969ff9b80d8c2998d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.480156 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1458/2916] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Aug 8 02:36:17 2022] DELETE /identity/v3/users/001b7b669cc041969ff9b80d8c2998d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:17.651986 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:17.653535 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:17.667100 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c7d9b-3e79-4b27-9bf2-48484a99ce03 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:17.671483 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:17.727405 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7afcca3526940e6b32f29d6912ef770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5a665df524c40cebad50de6721ccb89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:17.728063 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:17.728343 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:17.728615 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] PATH_INFO: `/v3/projects/0484b5182f684cfface7e89c16bf7e62` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:17.729754 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0484b5182f684cfface7e89c16bf7e62)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:17.731653 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:17.779387 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0484b5182f684cfface7e89c16bf7e62', 'request_id': 'req-3a36c374-d1b9-4605-8b86-b7d5d681047f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.785300 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0484b5182f684cfface7e89c16bf7e62', 'request_id': 'req-3a36c374-d1b9-4605-8b86-b7d5d681047f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.792629 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0484b5182f684cfface7e89c16bf7e62', 'request_id': 'req-3a36c374-d1b9-4605-8b86-b7d5d681047f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.803730 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] The token cache is being invalidate because project 0484b5182f684cfface7e89c16bf7e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:36:17.804020 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.804668 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3a36c374-d1b9-4605-8b86-b7d5d681047f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:17.806151 dv-cinder-852261-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1459/2917] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Aug 8 02:36:17 2022] DELETE /identity/v3/projects/0484b5182f684cfface7e89c16bf7e62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:27.477117 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:27.800869 dv-cinder-852261-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:19.711944 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:41:19.713379 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:41:19.854161 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee8ec-4b67-4883-8490-e811241d4efa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:41:19.912885 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3925e5acb5fb4f0dbaf5549b19119161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '352082ece5094e09ac27b3b4f64cc5e9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:41:19.913483 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:41:19.913761 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:41:19.914031 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:41:19.915741 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:41:19.927477 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:41:19.929096 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706edad-0481-442f-89b4-3ce54f8bebb8 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:41:19.938913 dv-cinder-852261-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1459/2918] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Aug 8 02:41:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:41:29.934687 dv-cinder-852261-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}